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ABSTRACT 

This Directory represents the start of a research program directed towards the creation 
of a human abilities matrix which cross-references data on real world jobs, laboratory 
performance tasks, and human performance models. The matrix will use the abilities 
r3quirements approach of Fleishman & Quaintance (1984) as the unifying element among 
these three dimensions. 

The present effort compiles and cross-references information on computer-based 
performance assessment batteries and models/theories of human performance. Data from 
ten batteries, one hundred twenty-three tasks, and seven models have been Included. For 
the performance batteries, this information includes availability/acquisition details as well a& 
computer hardware and software characteristics. This document, then, enables researchers 
to quickly access such data as well as to ascertain those areas in which a paucity of data 
exists. 

In general, it appears that current computerized performance batteries emphasize 
measurement of those characteristics which are most readily measured by computer, % .uhout 
regard for the applicability of such measureme^t to enhancement of reaNworld tas^s. In 
particular, a dearth of laboratory tasks with which to assess certain cognitive abilities was 
noted. This deficiency is regarded as particularly critical in light of the increased rel'ance on 
such abilities for performance on modern military and civilian jobs. 

Difficulties encountered and recommendations for future efforts are presented. 
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L IntroQUction 

A. Performance Elatteries 

With the increased availability of inexpensive yet powerful microprocessors has come an increasing 
number of computer-based human performance evaluation devices. These devices typically take the form 
of a series of tasks designed to assess human functioning in one or more areas such as information 
processing, perceptual-motor skills, and mood. 

Current computer-based perfonnance assessment batteries may include or may have evolved from 
task elements which existed previously in paper and pencil form (see e.g., the Criterion Task Set-CTS). as 
non micro-based batteries (e.g., the h/lultiple-Task Performance Battery -MTPB), or as other micro-ba&ed 
batteries (e.g., the Unified Tri-Services Cognitive Performance Assessment Battery--UTC-PAB). They 
may have been created to assess performance under a specific set of environmental conditions such as 
ship motion simulation (Naval Computerized Cognitive Test^-CCT), to examine the effects of particular 
circumstances such as agiog (Information Processing Performance Battery-IPPB), or to assess an 
individual's functioning in a specific area such as grammatical reasoning (Criterion Task Set-CTS). 

In general, computerized performance assessment batteries are both inexpensive and readily 
available to the scientific community. The Taskmaster system software, for example, is available free ot 
charge to individuals who forward two blank floppy disks to the Taskmaster creators ai NIOSH (National 
Institute of Occupational Safety and Health). One purpose of the present work is to catalog this arrray ot 
assessment tools with respect to their origins, intended purposes, and/or hardware and software 
characterisitics By so doing, we hope to provide not only a useful comparative index, but also to make 
clear those areas of human performance measurement which may be either too well- or too liiile- 
represented in existing batteries. 

A second goal of the present effort is to catagorize each battery'^ task elements usmg Fleishman & 
Quaintancp's (1984) "abilities" as the common language. These abilities 'hen, become the focus of 
comparison between/among the elements of the various task batteries. Reference to the Ability 
Catalog (Section II B) and the listed ability of "Response Orientation", for example, provides the 
information that six separate batteries and a total of thirteen individual task elements provide a pnmary 
assessment of response orientation. Reference to the ability "Information Ordenng", on the other hand, 
indicates that none of the evaluated battery components require use of this ability. All at ^(ty designaiions 
were made with reference to the list and descriptions of human abilities set forth by Fleishman & 
Quaintance (1984, Appendices B and C). 

The indicated relation of a specific ability to the task that best assesses that ability is made on the 
basis of expert judgemefit. These initial categorizations serve the exploratory nature of the present work. 
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However, in some cases a particular task is a direct "pure" measure of an ability, whiie m others the is 
only marginally related to a listed ability. Such issues, Inciuding the extent to which these tasks actually 
measure a specific ability, should be the subject of further quantitative analysis. 

B. Performance Models 

The second area of interest herein is that of "models" of human performance. In some cases theoe 
Tiodels offer a broad, possibly graphic conceptualization of human performance (e.g., Braune & Foshay, 
1983), while others may quantitatively represent specific human behaviors under specific performance 
corditions (seo, e.g.. Wherry & Curran, 1966). 

Meister (1985) has distinguished between "theories of behavior and ^'behavioral models\ He 
asserts (p 119) that the former are intended to describe functional relationships, are ludged by their 
validity, and may make reference lo "intervening variables with tenuous dimensions, such as motivation". 
The latter are used to predict behavior, are evaluated according to their utility, and their relationship to 
other variables •'must be quantifiable to some degree". The present work disregards such distinctions in 
order to include sufficient data to permit the creation and subsequent evaluation of the present Directory 
approach That is, behavioral models and theories of behavior are both deemed relevant and important 
dimer jns of the current effort, and it is not important to distinguish between them at this early stage in 
our lesearch program. 

The third goal of the present work is to assign appropriate ability designation?; to these human 
performance •'models" in order to enable researchers to effectively incorporate relevant pertormance 
theory information in nivestigations which use a performance battery. By again referring to the Ability 
Catalog, one may see that the Infomiation Ordering" and **Response Orientation** ability catagones are 
represented by two and five models, respectively. Ability based inter-battery and mter-modei comparisons 
are, therefore, possible as are model-to-battery and batteiy-to-model searches. 

C. Abilities 

An extensive history, dating back to the early Greeks, of the use of ability catagones m me siudy of 
human behavior is provided by Dunnette (1976) for the interested reader. Of importc:. ce here is 
Dunnette's assertion (p, 495) that it is the abilities requirements approach which affords the con- ^ptual 
link between the mi^ and lesl woWds of behavioral taxonomy. Although not considered to be a 
universally ideal taxonomy (see. e.g.. Companion & Corso. 1982). it is this linking capability which makes 
Fleishman's taxonomy the ideal candidate for use in a research program seeking to link" theoretical 
models, task batteries (test), and real-worid jobs (worl^). While other definitions are m use (see Dunnette. 
-^976. for a jiscussion of this issue), we will adopt Fleishman's characterization of an ability as a general trait 
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of ail individual which relates to his/her performance capacity on a variety of tasks. 

This abilities requirements approach represents "a longstanding program of research" conducted 
by Fleishman and his associates over the past two decades in order to define the fewest ability catagones 
which are associated with performance on the widest variety of tasks (Fleishman & Quamtance, 1984). in 
theory, a task can be described Ly the human abilities required for performance on that task. For example, 
it may be determined that the task "navigate ship" requires the abilities "Matnematical Reasoning\ opaiiai 
Orientation", and "Far Vision". Consequently, performance on related tasks can be predicted by 
ascertaining an individual's level of competance in applying or using these required abilities. 

Using this prodedure, a researcher can examine the effect(s) of a particular environmental stressor 
on specific task abilities. For example, the researcher may find that chemical defense protective clothing 
restricts the ability of "Far Vision". Degradation of performance on specific tasks can then be derived by 
profiling these tasks according to the required abilities, and generalizing from the stressor/ability 
degradation database. Thus, to the extent that a task involves "Far Vision" one can estimate the task 
degradation under specific environmental conditions. This, of course, simplifies a number of issues, not 
the least of which involves reliably relating abilities to corresponding measures or tasks. 

A heuristic entry point into the classification of abilities is to present a classification in terms of 
broader descriptors or ability domains. Drawing on the wori^ of Beriiner, Angell, & Shearer (1964), we have 
categorized human performance into five types of processes (see Table 1). This classification scheme 
allows one to identify any number of specific behaviors (e.g., scans) as an instance of a broader category of 
aclMieS-(e.g., attends to sensory information) that compose an ability process (e.g., perceptual). This 
provides a shorthand method in which one can quickly categorize a particular behavior of interest. 

There are five major ability domains under which these behaviors are subsumed. This taxonomy 
allows one to discriminate between types of abilities as, for example, those associated with cognitive 
versus physical tasks. However, researchers have argued that these categories are not unitary, in other 
words, two cognitive abilities such as "Memorization" and "Time Sharing" may be as different from one 
an ^her as they are from those required in performing a physical task. Thus, classificatory systems based 
on such broad categories may not allow dependable predictions to be made of performance from one lasK 
to another Greater specificity may be gained by breaking down these categones into a limited number ot 
abilities, which should account for most of the variability in task performance. Fleishman and Quaintance 
(1984, Appendix B) have presented fifty-two such abilities, and in Table 2 these have been grouped into 
the five ability domains from Table 1 . 
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Table 1. Ability Domain Characteristics 



PROCESSES 
Cognitive 



Communication 



Perceptual 



Physical 



Psychomotor 



ACTIVITIES 

encodes, stores, acts on, 
or retrieves information; 
problem solving 



interacts with others 



attends to, searches for, 
or identifies sensory 
information 

uses body power or 
movement 



makes coordinated, 
manipulative, repetitive 
or precise movements 
defined by speed and 
accuracy 



BEHAVIORS 

compares, selects, chooses, 
counts, estimates, searches, 
analyzes, decides, 
calculates 

reads, writes, talks, asks, 
listens, directs, instructs, 
coordinates, requests, leads, 
transmits 

scans, observes, tracks, 
receives, detects, locates, 
monitors, recognizes 

moves, walks, runs, lifts, 
twists, jumps, places, 
carries, balances 

handles, manipulates, turns, 
adjusts, connects, aligns, 
positions, depresses, tunes 



4 
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Table 2. Classlflcatfon of Fleishman's Abilities Into Ability Domains 



COGNITIVt^ 

Category Flexibility 
Deductive Reasoning 
Flexibility of Closure 
Fluency of Ideas 
Inductive Reasoning 
Information Ordering 
Mathetical Reasoning 
Memorization 
Number Facility 
Originality 
Perceptual Speed 
Problem Sensitivity 
Selective Attention 
Spatial Orientation 
Speed of Closure 
Time Sharing 
Visualization 

COMMLJNIOATIOM 

Oral Comprehension 
Oral Expression 
Speech Clarity 
Speech Hearing 
Written Comprehension 
Written Expression 



PERCEPTION 

Auditory Attention 
Depth Perception 
Far Vision 
General Hearing 
Glare Sensitivity 
Near Vision 
Night Vision 
Peripheral Vision 
Sound Localization 
Visual Color Discrimination 

PHYSICAL 

Dynamic Flexibility 
Dynamic Strength 
Explosive Strength 
Extent Flexibility 
Gross Body Coordination 
Gross Body Equilibrium 
Stamina 
Static Strength 
Trunk Strength 

PSYCHOMOTOR 

Arm-Hand Steadiness 
Control Precision 
Finger Dexterity 
Manual Dexterity 
Multilimb Coordination 
Rate Control 
Reaction Time 
Response Orientation 
Speed of Limb Movement 
Wrist-Finger Speed 
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D. The Research Program 

A research program which was in some ways conceptually similar to that descnbed here is that ot 
Allen, Rose, & Kramer (1978). They defined nine information processing operations and evaluated the 
extent to which these operations were used in performing each of the eight tasks comprising their 
non'Computerize(^ Information Processing Performance Battery*. They report, for example, that 
performance of "Mental Addition" requires use of transformation, storage, and refr/ei^a/ operations. On the 
other hand, use of their operations/ta^k matrix in inverse fashion reveals that abstraction is brought to bear 
only in their "Sentence Recall" and "Sentence Recognition" tasks. The stated rationale for adopting such 
an approach is that "...individuals can potentially be characterized in temns of parameters derived from 
models of selected information processing tasks" and that a battery of such tasks "...would not only be 
potentially predictive of performance on a wide variety of real world tasks but would also be fimnly based in 
theory" (Allen, et al., 1978). 

Goldstein (1980), following a comprehensive review, has concluded that "...no procedures exist that 
empirically establish the content validity of a training program based upon a match of relevant tasks on the 
job and in the training program. Further, Fleishman & Quaintance (1984) note that "tasks selected m 
laboratory research often are not based on any clear rationale about the class of task or skill represented". 
The taxonomy of human abilities set forth by Fleishman & Quaintance (1984, Appendix B) is thought to 
provide the common language and evaluative criteria through which these three areas (i.e., jobs, laboratory 
tasks, training programs) can be cross-referenced and cross-utilized. While ihis taxonomy is but one of 
many available, it was chosen for use here primarily because of the specificity of catagonzation it atlords- 
i.e., fifty-two identified abilities. 

The present wori< adds performance theory and'or model information to the performance battery 
user's data bank, and the proposed follow-on efforts would provide human ability requirements of actual 
shipboard or other real-world tasks to be added to this data bank through traditional task analytic endeavors 
(see, for example, Peterson & Bownas, 1982). This research program, then, enables formulation of a 
job-performance model-laboratory task matrix which uses catagories of human ability as the cornmon 
"language" among these three dimensions, and takes advantage of the aforemei.tioned hnkmg capdUility of 
the abilities requirements approach. Such a lystem when fully implemented would, for example, enhance 
training systems development by providing in one document the key human characteristics (i.e., abilities) 

* Note: this "IPPB" is unrelated to the Wickens, et al. (1985) computerized battery of the same name (see 
Section II C). 
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required for performance on a real-world job, along with the basic theoretical information necessary to 
understand that particular type of performance (i.e., modelsAheories), and the appropriate tools (i.e., 
laboratory tasks) required to study or train performance on that task, thereby increasing the effciency ot the 
training process. 

In Section II B--thG Ability Catalog-Fleishman's fifty-two abilities are presentee, and defined m 
alphabetical order and, in most cases. Navy-relevant job examples are provided. Following this, the 
microcomputer batteries (in boldface) and tasks which tap or assess each ability are detailed along with the 
human perfromance models/theories deemed relevant for that ability. For example, th j ability "Spatial 
Orientation" can be measured by the Maze Tracing task on the IPPB battery, and the Wickens (1980a) 
Multiple Resource Model detailed in Sectionll D may offer some theoretical information related to this ability. 
For certain abilities, particularly those in the Pftys/ca/ domain such as"Dynamic Strength", a suitable 
non-computer based assessment task is specified (e.g., push-ups). 

Decisions regarding the assignment of assessment tasks to specific abilities, although made on the 
basis of expert judgement, were frequently not clear-cut. For example, a task called Reariion Timft 
(Taskmaster battery) includes both simple ("Reaction Time") and choice ("Response Cnentation") reaction 
time tasks. Of course, this task has been categorized accordingly. Further, although the MTPB s Code 
Loch Solving task imparts information by way of colored lights, use of "Visual Color Discrimination" abilities 
was considered incidental to performance on this task (i.e., the task is not designed to assess these 
abilities) and so Code Lock Solving is not included in the "Visual Color Discrimination" entry. Similarly, 
although every auditory task might, of necessity, require "General Hearing" ability, and every task requmng a 
keyboard input might require "Finger Dexterity", such categorizations were considered trivial and 
inappropriate unless the ability was a significant focus of a particular task. 

It is important to note that, due to the relative numbers of each, the set of task batteries included here 
(ten batteries, one hundrad twenty-three tasks) is substantially more representative of the population of 
such batteries than is the set of included models (seven) representative of the considerable number of 
human performance models (see, e.g.. Pew, Baron, Feehrer, & Miller, 1977). The current effort is seen as 
the development of a new approach and should be regarded as an initial activity in a long-range, 
comprehensive research program. 
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11. Directory 

This Directory '\s in five parts. 

* Section II A, Index of Abbreviations, details tlie abbreviations/acronyms used in ttie 
remaining seclions. 

• Section II B. the Ability Catalog . is considered the focal point of the present effort. In it 

are listed thd Fleishman & Quaintance human abilities and their corresponding descriptions and examples 
(1984. Appendices B, C). For each ability are listed the battery(ies) and specific task{s) requinng that ability 
and/or the performance "model(s)" concerned with or incorporating that ability. 

* Section II C provides details of the Computer-based Performance Assessment 
Batteries. Note that to assure the accurate representation of each battery, we have, to the greatest 
extent possible, incorporated the original authors" exact text in our descriptions. For each task element 
detailsd. we have indicated the ability from Section II B that is judged to be primarily associated with 
performance on that task In some cases, a "construct" (UTO-PAB) or "psychological factor (Taskmaster 
battery) has been provided by the original authors and has been included herein. Our purpose is not to 
provide a comprehensive specification for each task, but rather to offer sufficient detail to enable the reader 
to make broad comparisons between/among battery elements and to ascertain which original manuscripts 
to acquire. 

Section 11 D contains the summary descriptions of the Human Performance Models / 
Theories reviewed. Again, to assure the accurate presentation of this information, we have, to the 
greatest extent possible, incorporated the original authors" exact toxt in our descnptions. The Fleishman & 
Quaintance "abilities" deemed relevant for each model are listed following the summary description. 

• Section II E, Task Source References lists those sources cited by the original authors 

as providing additional and/or historical data relevant to a particular task. In many cases (e.g., "Grammatical 
Reasoning" and the many variations of the Sternberg \ask), tasks of similar name have the same orgin. even 
though each battery creator may not have provided such details. 



.18 



NTSC TR86-020 



II A. Index of Abbreviations 

BATTERIES 

APT. Automated Poitable Test System 
CTS. Criterion Task Set 

IPPB. Information Processing Perfornaance Battery (Wickens, et al., 1985) 
MTPB. Multiple-Task Performance Battery 
PORTA-BAT. Basic Attributes Tests-Version 4 

NAVAL CCT. Naval Biodynamics Laboratory- Computerized Cognitive Testing battery 
NES. Computer-Based Neurobehavioral Evaluation System 
TASKMASTER. Taskmaster System / NIOSH Perfromance Battery 
UTC-PAB. Unified Tri-Services Cognitive Performance Assessment Battery 
WRAIR-PAB. Walter Reed Army Institute for Research Performance Assessment Battery 

MODELS 

BRAUNE. Braune&Foshay, 1983 
CHU. Chu & Rouse, 1979 
LEVISON. Levison, 1982 
MURALIDHARAN. Muralidharan, et al., 1979 
SANDERS. Sanders, 1983 
WHERRY. Wherry & Curran, 1966 
WICKENS. Wickens,1984 
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II B. ABILITY CATALOG 



I 



Arm-Hand Steadiness 



The ability to keep the arm and hand steady (Examples: Thread a needle, light a 
cigarette;. 

B^TTmY^/^(S) MODELfS^ 

TASKMASTER none located to date 

- Hand Steadiness 



Auditory Attention 

The ability to focus on a single source of auditory information in the presence of other 
distracting and irrelevant auditory stimuli (Example. Receive Morse code in a noisy radio 
room). 

BATTERY^ASKfS^ MODELfS^ 

IPPB Wickens 

- Dichotic Listening 
UTC-PAB 

- Dichotic Listening 



Category Flexibility 

The ability to produce many rules so that each rule tells how to group a set of items in a 
different way. Each different group must contain at least two items from the original set 
(Examples: Sort nails on the basis of length; select fuses for projectiles ). 

BAnERYn"ASK(s?) iVlODELfS^ 

none located to date Braune 



Control Precision 

The ability to move controls of a machine or vehicle quickly and repeatedly to exact positions. 
(Examples: Manipulate winch, crane, or "mule" (tow truck) controls). 

BATTERY/TASK(g) MODELfS^ 

NAVAL CCT Muralidharan 

-Maze Task Sanders 

NES Levison 

- Hand-Eye Coordination Test Wickens 
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Control Precision 
(cent.) 



Depth Perception 



PORTA-BAT 

- Psychomotor Device Tests 



The ability to distinguish which of several objects is more distant or nearer the observer, or to judge 
the distance of an object from the observer (Examples. Operate a cran^, fire a line-throwing gun, 
estimate range of targets; judge distance of other vessels). 

BATTERYn-A?K(s^) MODEL(S\ 

none located to date none located to date 



Deductive Reasoning 

The ability to apply general rules to specific problems to come up with logical answers 

and decide if an answer makes sense (Examples: Design an aircraft wing using the pnnciples 

of aerodynaaiics; navigate by dead reckoning; compute ship speed and course). 

BATTERY/TASKrfi^ MQDEUSi 

CTS Braune 

- Grammatical Reasoning Chu 
NAVAL CCT Muralidharan 

- Code Substitution Wherry 
-Visual and Auditory 

Grammatical Reasoning 

TASKMASTER 

- Grammatical Reasoning 

- Grammatical Reasoning with 

Reaction Time 
UTC-PAB 

- Grammatical Reasoning 

(Symbolic) 

- Grammatical Reasoning 

(Traditional) 
WRAIR-PAB 

- Encoding/Decoding 

- Logical Reasoning 
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Dynainfc Flexibility 

The ability to bend, stretch, twist, or reach out quickly and repeatedly with the body, arms, or legs 
(Examples: Swim, pull a "-ope, climb a ladder). Maybe tested with a repeated floor touch test, 

BAnERY/TASK(S) MODELfS^ 

none located tc date none located to date 

Dynamic Strength 

The ability to repeatedly or continuously exert force over a long period. This includes the ability to 
support, hold up, or move one's own body weight (Examples. Haul in a line, load ammunition). 
May be tested with pull-ups and push-ups, 

BATTFRY/TASKfS^ MODEL/S^ 

none located to date none located to date 

Explosive Strength 

The ability to use short bursts of force to propel an object or one's ov^n weight (Examples. Throw a 
heavy line; hooK an aircraft to a catapult, run with a fire hose). May be tested with sprint runmng. 

BATTERY^ASK(S) MODELfS^ 

none located to date none located to date 

Extent Flexibility 

The ability to bend, stretch, twist, or reach out with the body, arms, or legs (Examples. Pick up a 
wrench; perform aircraft maintenance on hard to reach equipment). May be tested with twisi and touch 
exercises. 

BATTERY/TASKfR^ MODEUS^ 

none located to date none located to date 

Far Vision 

The capacity to see distant environmental sun-oundings (Examples. Receive semaphore, identify 
bouys; detect differences in ships on the horizon; perform lookout dut 

BATTERY/TASKfS^ MODEUS^ 

none located to date none located to date 
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Finger Dexterity 

The ability to make skillful, coordinated movements with the fingers to grasp, place, or move small 
objects (Example: Tie/untie seamanship knots, align/adjust electronic equipment, arm or make 
connections on missiles). 

MEISRY^ASK(S) MODELfS^ 

CTS none located lo date 

- Interval Production 

- Unstable Tracking 
IPPB 

- Critical Instability Tracking 

- Second Order Tracking 
NAVAL CCT 

- Maze Task 
NES 

- Hand-Eye Coordination 
PORTA-BAT 

- Psychomotor Device Tests 

- Time Sharing 
TASKMASTER 

- Response Alternation 
UTC-PAB 

- Interval Production 

- Unstable Tracking 



Flexibility of Closure 

Tlie ability to identify or detect a known pattern (like a figure, word, or object) that is hidden 

in other material (Example: Find a particular size nut or bolt from an assortment of nuts and bolts ). 

BAnERYn"AgK(S) MODEIJS) 

CTS Sanders 

- Memory Search 
IPPB 

- Embedded Figures 
PORTA-BAT 

- Embedded Figures 
UTC-PAB 

- Visual Scanning 
WRAIR-PAB 

- Six-Letter Search 

- Two-Letter Search 

- Visual Scanning 
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Fluency of Ideas 

The ability to produce a number of ideas about a given topic (Example. Brainstorm to generate possible 
solutions to a problem). 



BATTERY/TARKr5^^ 
none located to date 



MQI2EKS1 

none located to date 



General Hearing 

The ability to detect and discriminate among sounds that vary in pitch andor loudness (Example. 
Distinguish between/among general, collision, chemicd, and crash alarms). 



BATTERY/TASK^Q ^ 

TASKMASTER 
- Noise Fusion 



MQDEL(S) 

none located to date 



Glare Senf^ltlvlty 

The ability to see objects in the presence of glare or bright ambient lighting (Examples. Delect 
submarine periscopes or torpedo wakes). 



BATTERY/TASK/S\ 
none located to date 



Levison 



Gross Body Coordination 

The ability to coordinate the movement of the arms, legs and torso together in aclivdies where itie 
whole body is in motion (Examples. Climb a ladder, man a fire hose). May be tested by jump-roping. 



BATTERYAASK/S\ 
nono iocated to date 



none located to date 



Gross Body Equilibrium 

The ability to keep or regain one's body balance or to stay upright when in an unstable position 
(Examples: Work while standing on a ladder, walk with slippery footing conditions, stand on-board ship 
in heavy seas). 



BATTERYn-ASK/S^ 
none located to date 



MO DEL(S) 

none located to date 



mc 
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Inductive Reasoning 

The ability to a^mbine separate pieces of information, or specific answers to problems, to form general 
rules or conclusions. This involves the ability to think of possible reasons why things go together 
(Examples: Interpret a weather chart; interpret sonar information). 

BATTER„^ASK(S) MODELfS^ 

CTS Braune 

- Linguistic Processing Chu 
MTPB Muralidharan 

- Code Lock Solving Wherry 
NAVAL CCT 

-Logic Task 
UTC-PAB 

- Linguistic Processing 

- Linguistic Processing-Choice Reaction 

Time Combination 



Information Ordering 

The ability to follow correctly a rule or set of mles to arrange things or actions in a certain 
order. The rule or set of rules used must be given. The things or actions to be put in order 
can include numbers, letters, words, pictures, procedures, sentences, and mathematical or 
logical operations (Example: Establish fault detection procedures). 



BATTERVVT ARK(g\ 
none located to date 



M ODEL(S) 
Chu 

Muralidharan 



Manual Dexterity 

The ability to quickly make skillful coordinated movements of one hand, a hand and an arm, or two 
hands to grasp, place, move, or assemble objects such as tools or blocks (Examples. Pack items m 
crates: make equipment repairs; arm weapons). 



BATTERY/TASKrS^ 

NAVAL CCT 
- Spoke Task 



MQD[:L(S) 

none located to date 
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Mathematica! Reasoning 

The ability to understand and organize a problem and then select a mathematical method or fnrr.iuia to 
solve the problem (Exarrples. Determine how to calculate a trajectory, determine compass course}. 



BATTFRY/TASKfS^ 

none located to date 



MQPEUS) 

none located to date 



Memorization 

The ability to remember information, such as words, numbers, pictures and procedL.es. 
Pieces of information can be remembered by themselves or with other pieces of information 
(Example: Memorize the pledge of alleyiance to the flag). 



BATTFRY/TASKfS^ 
CTS 

- Continuous Recall 

- Mathematical Processing 

- Memory Search 
IPPB 

- Absolute Difference Calculation 

- Auditory-Verbal Sternberg 

- Visual-Spatial Sternberg 

- Visual-Verbal Sternberg 
MTPB 

- Code Lock Solving 

- Target Identification 
NAVAL OCT 

- Auditory Digit Span 

- Logic Task 

- Pattern Comparison 

- Sternberg Memory Scanning 

- Visual or Auditory Serial Addition 
NES 

- Digit Span 

- Paired Associate Learning 

- Pattern Memory 

- Memory Scanning 
PORTA-BAT 

- Immediate/Delayed Memory 

- Item Recognition 
TASKMASTER 

- Arithmetic Speed 

- Free Recall of Word List 

- Grammatical Reasoning 



MODEKS) 
Wickens 



ERLC 
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Memorization 
(cent.) 

UTC-PAB 

- Continuous Recall 

- Mathematical Processing 

- Matrix Rotation 

- Memory Search 

- Shbrt-Temi Memory 
WRAIR-PAB 

- Digit Recall 

- Pattern Recognition I 

- Pattern Recognition II 

- Serial Add/Subtract 



Multilimb Coordination 

The ability to coordinate movements of two or more limbs such as in moving equipment controls 
(Examples: Operate a forklift, winch, crane, **mule", etc.). 

RATTERVn-ASKfS) MODELfS^ 

PORTA-BAT none located to date 

- Psychomotor Device Tests 

Near Vision 

The capacity to see close sun-oundings (Examples. Read fine print, identify cable/wire markings). 
BAnERYrrASK(??) MQDEUSl 
none located to date Levison 



Night Vision 

The ability to see under low light conditions (Example. Detect phosphorescent wakes from small 
craft). 

BATTERY/TASK(S) MODEL^S^ 
none located to date Levison 



Number Facility 

This involves the degree to which adding, subtracting, multiplying, and dividing can be done 
quickly and correctly. These can be steps in other operations like finding percentages 
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Number Facility 

(com.) 

and taking square roots (Examples. Inventory parts or supplies, calculate ship closing rates during 
manuevering ). 

BATTERY/TASKfS^ MODELfS) 

CTS none located to date 

- Mathematical Processing 
IPPB 

- Absolute Difference Calculation 
MTPB 

- Arithmetic Computations 
NAVAL OCT 

-Math Test 

- Visual or Auditory Serial Addition 

t; skmaster 

- Arithmetic Speed 
UTC-PAB 

- Mathematical Processing 
" Two Column Addition 
WRAIR-PAB 

- Serial Add/Subtract 
-Two Column Addition 



Oral Comprehension 

The ability to understand spoken words and sentences (Example. Understand verbal orders or 
instructions). 

BATTERY/TASK( S) MODELfS^ 

none located to date none located to date 



Oral Expression 

The ability to use words and sentences in speaking so ethers will understand (Examples. Give 
instructions; relay information). 

MUEBmrnm MODELfS) 

none located to date none located to date 
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Originality 

Tlie ability to generate novel ideas ragarding a particular issue or situation and'or to invent creative 
solutions to problems (Example: Use a credit card to open a locked door). 

BATTERYn"ASK($) MODEKS^ 

none located to date none located to date 



Perceptual Speed 

This involves the degree to which one can compare letters, numbers, objects, pictures, or 
patterns, quickly and accurately. The things to be compared may be presented at the same 
time or one after the other. This ability also includes comparing a presented object with a 
remembered object (Examples. Inspect assembled electrical components for defects, compare 
readings from a bank of dials/gauges; identify radar returns on a scope). 

BATTERY^ASK(S) MODEL^S) 

CTS Braune 

- Continuous Recall Sanders 
" Linguistic Processing 

- Memory Search 

- Spatial Processing 
IPPB 

- Auditory-Verbal Sternberg 
-Visual-Spatial Sternberg 

- Visual-Verbal Sternberg 
MTPB 

- Target Identification 
NAVAL CCT 

- Code Substitution 

- Pattern Comparison 

- Sternberg Memory Scanning 

- Visual or Auditory Recognition 
NES 

- Continuous Performance 

- Memory Scanning 

- Pattern Memory 

- Pattern Recognition 

- Symbol-Digit Substitution 

- Visual Retention 
PORTA-BAT 

- Dot Estimation 

- Encoding Speed 

- Item Recognition 

- Immediate/Delayed Memory 

- Mental Rotation 

- Perceptual Speed 
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Perceptual Speed 
(cx)nt.) 

UTC-PAB 

- Alpha-Numeric Visual 

Vigilance 

- Code Substitutions 

- Continuous Recall 

• Linguistic Processing 

- Linguistic Processing-Choice 

Reaction Time 

• Matrix Rotation 
-Memory Search Task 

- Pattern Comparison (Simultaneous) 

- Pattern Comparison (Successive) 

- Short-Term Memory 

• Spatial Processing 

- Continuous Recall 
WRAIR-PAB 

- Digit Recall 

- Pattern Recognition I 

- Pattern Recognition II 

- Six Letter Search 

- Two Letter Search 



Peripheral Vision 

The ability to perceive objects or movement in the edge of the visual field (Example. Monitor the 
instrument panel of a jet aircraft). 

BATTERY/TASK(S^ MODFI (S) 

CTS none located to date 

- Probability Monitoring 
MTPB 

- Probability Monitoring 
UTC-PAB 

- Visual Probability Monitoring 



Problem Sensitivity 

The ability to tell when something is wrong or is likely to go wrong. It includes being able to 
identify the whole problem as well as the elements of the problem (Examples. Recognize 
an illness at an eariy stage of a disease when there are only a few symptoms, detect crew morale 
problems). 
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Problem Sensitivity 
(cont.) 

BATTERY/TASK(?) MODFl (S) 

none located to date Braune 

Chu 

Muralidharan 
Wherry 



Rate Control 

The ability to adjust an equipment control in response to changes in the speed and/or direction 
of a continuously moving object or scene. This ability does not extend to situations in which both the 
^"eed and direction of the object are perfectly predictable (Example. Maintain a gun sight on a moving 
target). 

BATTERY/TASKfS^ MOHFIYS^ 

CTS Wickens 

- Unstable Tracking 
IPPB 

- Critical Instability Tracking 

- Second Order Tracking 
PORTA-BAT 

- Time Sharing 
UTC-PAB 

- Unstable Tracking Task 



Reaction Time 

The ability to give one fast response to one signal (sound, light, picture) when it appears. 
This ability involves the speed with which the movement can be started with the hand, 
foot, or other parts of the body (Example: Duck to miss being hit by an object). 



BATTERY/TA$K(§) MODELfS) 

NES Chu 

- Continuous Performance Test Muralidharan 

- Simple Reaction Time Sanaers 
TASKMASTER Wherry 

- Grammatical Reasoning with Wickens 

Reaction "ilme 

- Reaction Time 
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Response Orientation 

The ability to choose between two or more movements quickly and accurately when two or more 
different signals (lights, sounds, pictures) are givtn. The ability is concerned with the speed 
with which the correct response can be started by the hand, foot, or other parts of the body 
(Example: Operate a busy telephone switchboard). 



gATTERY^ASK(?) MODELfS^ 

MTPB Chu 

- Blinking Lights Monitoring Muralidharan 

- Warning Lights Monitoring Sanders 
NAVAL OCT Wherry 

- Choice Reaction Time Wickens 



- Manikin 

- Stroop-like Color Naming 
PORTA-BAT 

- Decision-Making Speed 

- Perceptual Speed 
TASKMASTER 

- Reaction Time 
UTC-PAB 

- Alpha-Numeric Visual Vigilance 

- Four-Choice Serial Reaction Time 

- Linguistic Processing- 

Choice Reaction Time 

- Manikin Test 

- Sternberg-Tracking 

- Slroop Test 
WRAIR-PAB 

- Four-Choice Serial Reaction Time 



Selective Attention 

The ability to concentrate on a task, including boring tasks (Examples. Carry on a conversation m a 
noisy room; watch a radar screen). 

BATTERYy-rASKfS^ MODELfS^ 

IPPB Braune 

- Dichotic Listening Chu 
NAVAL OCT Sanders 

- Stroop-like Color Naming Wickens 
TASKMASTER 

- Zip Code Typing 
UTC-PAB 

- Manikin Test 

- Stroop Test 
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Sound Localization 

The ability to identify the direction from which an auditory stimulus originates relative to the observer 
(Examples. Locate someone calling your name or the source of a sonalert or other audible alarm signal). 



BATTFRY/TA5^KrS^ 

none located to date 



MQPEL(S) 

none located to date 



Spatial Orientation 

The ability to determine your position in relation to some object, or to ascertain the object's position m 
relation to you (Examples. Locate your position on a chart, manuever your ship in relation to others, 
position aircraft on a flight deck). 



BATTERY/TARK^S^ 
IPPB 

- Maze Tracing 



MODELfS^ 
Wickens 



Speech Clarity 

The ability to communicate orai;> in an understandable fashion (Examples. Calling out numbers to 
someone; speak over a megaphone or telephone). 



BATTERVn-ASKfS^ 
none located to date 



MODELfS^ 

none located to date 



Speech Hearing 

The ability to understand the speech of another person (Example. Understanding verbal instructions). 



BATTERY/TASKfS) 

NAVAL CCT 

-Auditory Digit Span 

- (Visual and) Auditory Grammatical 

Reasoning 

- (Visual or) Auditory Serial Addition 



MODEUS^ 

none located to date 
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Speed of Closure 

This involves the degree to which different pieces of information can be combined and organized 
into one meaningful pattern quickly. The material may be visual or auditory (Example. Interpret patterns 
on a weather chart). 

BATTERYyTASKfS^ MODELfS^ 

MTPB Braune 
- Code Lock Solving 

Speed of Limb Movement 

This involves the speed with which a single movement of the anns or legs can be made irrespective of 
accuracy or coordination of movement (Examples. Swat at a fly. play out line replenishment). 

BATTERYn"ASK(S) MODEirs^ 

none located to date Sanders 



Stamina 

The ability to withstand considerable physical exertion without becoming winded or faugued 
(Examples: Fight a fire; load ammunition). May be tested with a mile run test. 

BATTERY/TASKfS^ MODEIYR^ 

none located to date none located to date 

Static Strength 

The ability to lift, push, pull, or carry objects. It is the maximum force one can exert for a brief period 
(Examples: Lift ammunition; man a high pressure hoze nozzle). May be tested with a we/oht 
lift \esl 

BAnERY^ASK(s7f MODEirS^ 

none located to date none located to date 

Time Sharing 

The ability to shift back and forth between two or more sources of information (Example. Simultaneously 
monitoring information from several teletypes or display screens). 
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Time Sharing 
(cont.) 

CTS 

- Probability Monitoring 
IPPB 

- Second Order Tracking 
MTPB 

- Probability Monitoring 
PORTA-BAT 

- Psychomotor Device Tests 
-Time Sharing 
UTC-PAB 

- Linguistic Processing-Choice 

Reaction Time 

- Sternberg-Tracking 

- Visual Probability Monitoring 
TASKMASTER 

- Grammatical Reasoning with 

Reaction Time 



Trunk Strength 

The ability of one's stomach and lower back muscles to resist fatigue as they repeatedly or continuously 
support part of the body (Example. Lift heavy objects from the ground). May be tested by sit-uy and 
leg-lift lests. 

BATTFRY/TASKfS^ MODEL(S^ 

none located to date none located to date 



Visual Color Discrimination 

The capacity to match or detect differences between colors and/or levels of color saturation and 
brightness (Examples: Match grains from samples of wood, discriminate landing hghis. detect types 
of navigational running lights on a vessel). 

BATTFRY/TASK^S^ MODELfS^ 

NAVAL CCT none located to date 

- Manikin 

- Stroop-like Color Naming 
UTC-PAB 

- Manikin 
-Stroop Test 



MODEL(S) 

Levison 
Wickens 
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Visualization 

The ability to imagine how something will look when it is moved around or when its parts are 
moved or rearranged. One has to predict how an object, set of objacts, or pattern will appear after the 
changes are carritd out (Examples. Know how to cut and fold a piece of paper to make a cube, position 
aircraft on a flight deck, read another ship's running lights as it manuevers in relation to own ship). 

BATTERVrrASKfS^ MODELfS^ 

CTS none located to date 

- Spatial Processing 
MTPB 

- Target Identification 
NAVAL OCT 

- Manikin Test 
PORTA-BAT 

- Mental Rotation 
UTC-PAB 

- Manikin Test 

- Matrix Rotation 

- Spatial Processing 



WrIst-FInger Speed 

The ability to make fast, simple, repeated movements of the fingers, hands, and wrists without regard 
for accuracy or eye hand coordination (Examples. Transmit flashing light messages, screw nuts onto 
studs). 

BATTERY/TA§K(S) MOOFl YS^ 

APTS none located to date 

- Tapping 



Written Comprehension 

The ability to understand written sentences and paragraphs (Examples Understand written orders, 
instructions, or message traffic). 

BATTERY/TASK/S^ MODELfS^ 

CTS none located to date 

- Grammatical Reasoning 
NAVAL CCT 

- Visual and Auditory Grammatical 

Reasoning 
NES 

- Vocabulary 
PORTA-BAT 

- Self-Crediting Word Knowledge 
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Written Comprehension 
(cent.) 

TASKMASTER 

- Grammatical Reasoning 

- Grammatical Reasoning with 

Reaction Time 
UTC-PAB 

- Grammatical Reasoning (Traditional) 
WRAIR-PAB 

- Logical Reasoning 



Written Expression 

The ability to use words and sentences so others can comprehend (Example. Write a mebsage*. 
BATTERY/TASKfS^ MODELfS^ 
none located to date • none located to date 
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II C. Computer-Based Performance Assessment Batteriej 



Note: To assure the accurate representation of each battery, these descriptions are, to a great 
extent, presented in the words of the original author(s). 
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Automated Portable Test System (APTS) 



fiprTi^C^pl.^'^n''' ^T^"^^' "-S- Slaley. CF. & Harbeson, M.M. (1985). Automated Portable Test 
m) System: Overview and prospects. Behavior Research Method. in.tn,mpn.<^ f ^rmpiltrn 17^ 



?fc.c ?nr c °' " ^^^l"^ "P°" '^°"'^^P's and empirical findings of the Performance Evaluation 

Tests for Er^vironmental Research (PETER) Program (e.g.. Harbeson. Bittner. Kennedy. Carter. & Krause 
1983: see also Irons & Rose. 1985 and the NAVAL CCT description in this D.rectoryi. The PETER i^roaram 

°' psychometric properties-test stability, reliability, ar suitabSor 

use m repeated mesure designs.and a number of these tasks have been implemented in APTS. ThrAPTS 
has been developed as a tool for the a sessment of human performance and subjective status At oresenl 
COM /l"^ 'n investigalions of the effects of flight-simulator exposure on pilots, hypoxia ef eel on 
to hoSnp T ""'versity studies. The APTS is a notebook-sized microcompSer system that is said 
to be portable, mgged user fnendly. utilizes an independent power source and provides storage for data 
The producers contend that APTS is particularly useful for environmental research where time spaL and 

SfStrr °' UTC'^AB Sn APTS 

The APTS is produced and sold by ESSEX Corporation. Orlando, FL . 
Hardware/Software 

The hardware system is built around a notebook-sized eight bit personal computer, the NEC PC 8201A 
BAsTc" ^ '^°"'^''"'"9- addition to TELCOM and TEXT EDITOR, a version of Microsoft 

ESSEX Corporation provides software for the Automated Portable Test System in the form of tests and 
questionnaires. An additional PC-8206A 32Kb RAM cartridge must be purchased as the medium for 
shipmen and customer backup. Generally, up to five (5) tests or two (2) questionnaires may be placed on 
one cartridge. Scores available generally include Hits. Errors, and Latlncies. Whe?e approp^^'e' S °aL 
one ye£-'-' ''''''''' '^'^"^^y^ sofSls w^rran.e^^^^^^^ 

The following table abstracts the technical features of the microcomputer: 



FEATURE.'^ 



SPEOIFlCATinN.? 



Size 

Weight 

CPU 

ROM 

RAM 

Keyboard 
Display 



30x22x6 cm (11x8.25x2.5 in.) 
1.7 kg (3.8 lb) 

80C85 (CMOS version of 8085) with 2.4 MHz clock 

32K (standard) 128K (optional) 

16K (standard) 96K (optional) 

67 starxJard keys: 5 funclfon. 4 cursor directional, and 58 

additional 

19 X 5 cm (7.5 X 2 in) with reverse video oplfon ( may be 
configured as either a 240 x 64 element matrix or a 40 character 
X 8 line display) 



29 



39 



NTSC TR&S-020 



Interfaces 1 Parallel (Centronics compatible) and 3 serial (RS-232C and 6- 

and 8-pin berg jacks) 

Power Supply Options 4 AA nonrechargeable batteries, or rechargeable 

nickle-cadmium pack, or ac adapter 50/60 Hz @ 120 V ac, or 
external battery systems 



Tasks 

Following is a list of tasks that have been available for use with the APIS. Purchasers may select from this 
list those tasks that best suit their needs. No task descriptions were available from Essex at the time ol ihis 
report but, in general, they can be expected to be similar to those of like name m other batteries detailed m 
this Directory. 

1. Code Substitution 

2. Grammatical Reasoning 

3. Manikin 

4. Moving Landolt C 

5. Non-Preferred Hand Tapping 

6. Pattern Recognition 

7. Preferred Hand Tapping 

8. Reaction Time 

9. Sternberg 

10. Two-Hand Tapping 
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Criterion Task Set (CTS) 

Shingledecker,CA (1984). A task battery for applied h uman nfirformance ac;<^Pfifiment research , 
(Technical Report AFAMRL-TR-84). Dayton. OH. US Air Force Aerospace Medical Research Laboratory. 



The Criterion Task S * (CTS) is a battery of tasks which has been developed to provide an instnjment for 
human performance assessment that is both practical and firmly based in currem theoretical models of 
perceptual-motor and cognitive behavior. The component tasks place selective demands on the 
functional information processing resources of the human operator. The CTS" pnmary framework or model 
is derivad from multiple resource and processing stage theories. 

The theoretical basis and standardized features of the CTS are said to make it potentially applicable to a 
number of research problems in the areas of human performance assessment and human factors. One of 
the problems for which the CTS was originally designed was the comparative evaluation of measures of 
mental workload. In this application, the individual components of the CTS are being used as primary 
loading tasks to assess the reliability, sensitivity and intrusiveness of a number of proposed behavioral, 
subjective and physiological indices of workload. A second broad area of investigation to which the CTS 
can be applied as a standardized test instrument is the assessment of human performance capabilities. 
When used for this purpose, the tasks comprising the CTS may be employed in a diagnostic fashion to 
measure and predict the effects of extreme environments and biochemically active agents on human 
performance. 

Three significantly different demand (difficulty) levels have been established for each CTS task except 
Interval Production. Additional tasks are currently being developed for later inclusion into the CTS, and 
plans to adapt this battery for IBM-compatible m.achines are under consideration. 

Hardware 

The CTS is implemented on a commercially available microco.Tiputer system with a minimum of additional 
custom-built hardware. An equipment listing includes the following. Commodore 64 microcomputer. 
Commodore 1541 disk drive. Commodore C1526 printer (or MPS-801), Monochrome experimenters 
monitor (Panasonic WB5200 or equivalent with 75 ohm loop-through and female BNC video input 
connector). Commodore 1702 color subject's monitor (substitute not recommended), expenmenters 
video monitor switch and cables (custom), four button response keypad and cable (custom), tapping key 
and cable (custom), and rotary tracking control and cable (custom). 

Software 

The software for the CTS is written primari;^ in BASIC to run on the Commodore 64 computer. The majority 
of the programs are compiled to improve execution speed and efficiency. T le CTS software is structured 
to minimize experimenter familiarization and training requirements. Standaidized, self-explanatory rnonus 
are used for all tasks to simplify trial preparation and data handling activities. Once task software is loaded 
into the computer. Initial menus permit the experimenter to select training ur test conoitions and specific 
loading levels on the lask. 
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Task Descriptions 

Continuous Recall • This task is a standardized loading task designed to place variable demands upon 
processing resources associated with encoding and storage in working memory. The task requires an 
operator to utilize both immediate and short term memory of numbers under continously changing storage 
states. The memory test consists of a random series of visual presentations of numbers which the 
operator must encode in a sequential fashion. As each number in the series is presented tor encoding, a 
probe number is presented simultaneously. The operator must compare this probe number to a 
previously presented item that occurred at a prespecified number of positions back in the series. The 
operator must decide if the items are the same as/or different from the probe number. Task difficulty is 
manipulated by varying the number of digits in each item and the length of series which must be 
maintained in memory in order to respond to recall probes. The task is experimenter (comouier) paced 
(PERCEPTUAL SPEED, MEMORIZATION) 

Grammatical Reasoning • Variable processing demands on resources required for logical thought are 
imposed by this task. Stimuli are sentences of varying syntactical structure which refer to and are 
presented simultaneously with a set of symbols. Subjects must analyze the sentences to ascertain 
whether they correctly describe the relationship between/among tiie displayed symbols. Task complexity 
is varied by the amount and difficulty of grammatical analysis required, including, for example presentation 
of one versus two sentence stimuli, u§e of active versus passive wordings, and/or positive versus negative 
sentence structure. (DEDUCTIVE REASONING, WRITTEN COMPREHENSION) 

Interval Production - The operator is required to generate a series of equal time intervals by producing 
a consistent rat« of finger tapping within the range of one to three taps per second. The standard 
deviation of interval durations and an "IPT variability" score which corrects for the partial dependence of 
error magnitude on interval duration, are the dependent measures employed. (FINGER DEXTERITY) 

Linguistic Processing - This task places variable demands upon mental resources associated with the 
manipulation and comparison of linguistic information. The task requires classification of letter and word 
paTs as "same" or "different" on the basis of three stimulus dimensions, physical, categorical and antonym 
ranging from low to high task demand, respectively. Task difficulty is determined by the dimension along 
which stimuli are compared. Letter or word pairs are presented on a CRT. Subjects respond positively if 
the items match on the dimension in question or negatively othenwise. Reaction time and subjective 
ratings are evaluated. (PERCEPTUAL SPEED, INDUCTIVE REASONING ) 

Mathematical Processing • This task places variable demands upon information processing resources 
associated with the manipulation and comparison of numeric stimuli. The task requires the subject to 
perform one or more simple arithmetic operations on visually presented single digit numbers to determine 
whether the correct answer is greater or less than a prespecified value (5). Task complexity is determined 
by the number and combination of operations in the problems. Mean reaction times, percentage correct, 
and subjective ratings are collected. Tasks are subject paced with experimenter-set time constraints 
(NUMBER FACILITY; MEMORIZATION) 

Memory Search - This task is designed to place variable demands on human information processing 
resources dedicated to short-term memory retrieval functions. A small set of items (the "memory set") is 
first presented to the subject for memorization. A series of test items is then presented to the subject one 
at a time, and the subject must respond positively if the test item was contained in the memory set, or 
negatively if not. Reaction time is measured from the onset of the test item to the response. The task is 
composed of three fixed-demand levels produced by variations in the number oi items to be memonzed. 
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Memory Search (cont.) 

This task is subject paced within experimenter-set time constraints. Stimulus items in the CTS memory 
search task are visually presented alphabetic characters. Due to the acoustic confusability of certain 
EC ^ ^ s^^^"*^^" °* twenty-six letters of the alphabet are used in the task 

rom.-nfnn'il'^^^^^^^^V ^J^"^ "^""^ ^^^^^^^"^ ^'^"^ ^^e letter populatioH. and the 

rema ning rtems are used m the negative set. A new memory set is selected at the beginning of each three 

Sn'Jimf J ^ H • ^IS randomly generated with the restriction that positive and negative 

Iu^^OhSItS^^^^^^ - - '^^e-e^ keys. 

Probability Monitoring - (Note: this task has been recently revised. Details of this new version were 

•mflrmt n n °' '^^f ^'^^ ^^'"^ P'^^^^s variable demands on the visual perceptual 
information processing resources of the human operator. The task includes three fixed loading levels 
produced by variations in the number of signal sources (dials) and in the discriminability of signals. 
Subjects monitor either one. three, or four computer generated displays, having the appearance of 
eledro-mechanical dials. Each display consists of a row of six vertical hashmarks with the seventh mari< 
oftset above the others to indicate the center of the dial. Subjects are required to detect biased pointer 
^fnT^M JZ^^'^ ""Signaled and loaded conditions. Under ..ormal (nonsignal) conditions 

thfno n P?finlf ^^^"^ P°="'°" '° 3"°^her in a random fashion to sim lte 
the pointer fluctuations on an actual dial. At unpredictable intervals, the pointer on a display begins to 
move nonrandomly. staying predominantly to the left or right half of the dial. These biases in pointer 
movement are the targets or "signals" to which subjects are instructed to respond. By pressina the 
™ SI^TmP"^^^^^^^^ ""^^ ^e'""^e^ ^° ♦f^e nonsignal (random pointer r^ovement) state 

1™0n1 response orientation, some performance strategies may utilize PERIPHEfSAL 

Spatial Processing - This task is designed to place variable demands upon information orocessino 
S^un ["^"'P"'3«°" comparison of spatial infomiation. This task requires the 

subject to view a senes of histograms presented one at a time. The subject must determine whether the 
second hi^ogram in each set of two (the "comparison" hem) is identical to the first (the "targerS and 

Sid^^e^Sf I'lLT "r r 'r'' ^'"P^"^^" ^'^^^S^^'"^ --^ed She numbers 1 
nnmh; nf'^ l""? "^^^ ^^^"^ ^^mands are manipulated by varying the 

.imp. /nl K V^' and the spatial orientation of the comparison histogram. Mean reaction 

times and subjective ratings are collected. The task is experimenter paced within the range 1 5 to 3 5 
seconds increasing with task difficulty. (PERCEPTUAL SPEED. VISUALIZATION) 

"h!??^ Tracking - The execution of rapid and accurate manual responses are required by this task 
which has three possible levels of task demand. As a cursor moves vertically from the cente^f til C^^^^ 
screen, the subject attempts to re-center it through rotary movements of a control knob These 
T^HT' r error which is magnified by the system so that it becomes increasingly 

t^^^^c^r^ (SK^ — - - ^° - P-'- relative 
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Information Processing Performance Battery (IPPB) 

Wickens. C. D., Braune, R.. Stokes, A. & Strayer, D. (1985). Individual niffprnnces and AnP-RPiatPH 
Cnanqes: Refinemffnt and Elaboration of an informa tion PmcflRsina Performance Battsrv with Avi;^t.r.n 
Relevant Task StniCtlires (NAMRL-85-1). Pensacola, FL. U.S. Naval Aerospace Medical Researcti 
Laboratory. 

This test battery examines the general effects of aging on human information processing skills assumed to 
be relevant to, although not exclusively directed towards, aviation. It is said to be a ceneral demonstration 
of how performance analysis, controlled experimental manipulation, and factor analysis can reveai tne 
different dimensions of information processing and can demonstrate how these dimensions are 
influenced by a variety of factors. The combined techniques employed are reported to be equally 
applicable in examining the effects ot chronological aging, the effects oi stress level, the effects of 
different drugs or the effects of sleep deprivation. 

Hardware/Software 

Information not available in documents obtained to date. 
Task Descriptions 

Absolute Difference Calculation - The subject is presented with a series of digits through 
headphones. The subject's task is to calculate the difference between the last digit presented and tne 
previous one, and to press the appropriate button on a keyboard. In the sequence 4,1,5,3, for example, 
the correct responses would be 3,4, and 2. (MEMORIZATION, NUMBER FACILITY) 

Auditory-Verbal Sternberg (AV) - This task is identical to the above task, except that the stimuli are 
presented auditorily through headphones. (PERCEPTUAL SPEED, MEMORIZATION) 

Critical Instability Tracking - In this task, the subject moves a spring-loaded joystick in a left-right 
direction with the right hand in order to stabilize an unstable positive feedback element. The subjective 
impression of this task is that of balancing a dowell rod on the end of one's finger, while the rod 
progressively shortens in length. (RATE CONTROL, FINGER DEXTERITY) 

Dichotic Listening - The subject is simultaneously presented with a series of word and digit pairs to 
both ears During Phase I (focused attention), the subject reports only ths digits presented to one ear and 
ignores those presented to the other ear. During Phase II (attention switching) a cue is presented to 
switch the relevant ear, and the subject is judged on the accuracy of reporting the digits on the 
now-relevant channel. (AUDITORY ATTENTION, SELECTIVE ATTENTION) 

Embedded Figures - Subjects view a target pattem followed by a series of stimuli. For each stimulus 
the subject decides whether or not Ihe target pattem was contained in the stimulus pattern and indicates 
his/her response with a yes-no button press. (FLEXIBILITY OF CLOSURE, MEMORIZATION) 

Maze Tracing - The subject views a computerized maze and is required to decide as rapidly as possible 
whether or not there was an open path from start to finish and to so indicate by a Yes or No button oress 
(SPATIAL ORIENTATION) ^ 
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Second-Order Tracking - The subject manipulates a spring-loaded joystick m the left righi direction 
with the right hand in order to minimize the error on a horizontal compensatory display. Control is 
exercised using second order (double integral or acceleration) dynamics. The ^ubject attempts to track a 
band limited disturbance input with an upper cutoff frequency of 0.32 Hz. This task may be presented 
concurrently with the Stemberg visual tasks in which case the Sternberg responses are made wiih the leti 
hand. (TIME SHARING, CONTROL PRECISION, FINGER DEXTERITY) 

VIsual-Spatlal Sternberg (VS) • This task is analagous to the (VV) task, except that the stimuli consisi 
of line segments formed by connecting a pair of points in a two-by-three matrix. (PERCEPTUAL SPEED, 
MEMORIZATION, SPEECH HEARING) 

Visual-Verbal Sternberg (VV) • Prior to each trial, the subject is presented with a memory set of two or 
three randomly chosen letters. Each letter is presented for three seconds for two cycles. Following this 
presentation, a series of probe lette.s is presented, fifty percent of which are drawn from the memory set. 
The subject uses a two button control switch to indicate if the probe was or was not a member of the 
memory set. (PERCEPTUAL SPEED, MEMORIZATION) 
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Multiple-Task Performance Battery (MTPB) 

Morgan, Jr., B. B. & Alluisi, E. A. (1972). Synthetic work. Methodology for assessment of human 
performance. Perceptual and Motor Skil ls. 25, 835-845. 

At present, this is not a microcomputer based battery, but efforts to transfomn it into such are currently in 
progress. The MTPB incorporates five individual-perfurmance tasks and one group performance task 
The tasks are presented according to a repeated basic two hour schedule. With each cycle of the two hour 
performance period, a total of fourteen individual- and five group performance measures are obtained for 
each of the subjects. 

Typical MTPB Study 

The typica! MTPB study is conducted in four phases. Phase I consists of training for forty eight hours in 
blocks of no less than four hours. Phase II (baseline phase) typically consists of two consecutive days of 
MTPB performance following a four hour on, four hour off, foui hour on, and twelve hour off duty 
schedule. Phase III (expenmcntal phase) the variable of manipulation is imposed, the number of hours and 
period involved varies as a function of the particular investigation. There is typically a rest and recovery 
period immediately following the experimental phase during which no MTPB data are collected. Following 
this rest and recovery period there is Phase IV. the post rest and recovery phase, during which two 
additional consecutive days of MTPB performance data are collected according to the 4-4-4 12 work rest 
schedule. On a few studies, a fifth phase has been required to provide data regarding an additional 
independent variable. 

Task Descriptions 

Arithmetic Computations - The displgy for this task is presented along the lower central portion of the 
panel and consists of three three-digit numbers arranged horizontally. The subject is required to add the 
first thrDe-o.y.t number to the second and then subtract from their sum the third three-digit number. Use of 
paper and pencil is not permitted. The subject records an answer by manipulating four decade th_ -^b 
switches, and pressing a push button. A blue light indicates a cc.rect answer. Problems are presented at 
a rate of three per minute for thirty minute intervals. Performance is scored in terms of percentage of 
problems attempted and the percentage of problems correctly answered. (NUMBER FACILITY) 

Blinking Lights Monitoring - The subject is presented with two vertically arranged amber lights. 
Under normal conditions, the two lights flash akemately at an over all blink rate of two flashes per second 
The critical signal to be detected by the subject .s an arrest of this alternating operation. Subjects are 
required to respond by pressing a button locatec directly below the pair of lights. If the subject fails to 
respond within two minutes he/she receives the n.axirnur»i latency score. (RESPONSE ORIENTATION) 



Code Lock Solving - This is a group perfomnance task that requires a five m«n crew to discover the 
proper sequential order for depressing five push buttons, one for each member. Illumination of a red light 
indicates that a problem is present and unsolved. The amber light is presented when any one of the 
subjects depresses a button. The red light extinguishes when the first correct response is made. V/hen 
an erroneous response occurs, the red light is presented and the programming apparatus automatIca'!> 
resets to the beginning of the sequence. When all five push buttons have been depressed in the correct 
order, a green light is presented. Thare is a thirty second interval and the subjects are required to re solve 
the same problem. Then another thirty second interval occurs followed by a second original problem 
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Code Lock Solving (cent.) 

Performance measures include; time required for code look solutions, total number of responses made, 
total number of errors (program resettings), and the mean number of sequences solved per unil of lime. 
(INDUCTIVE REASONING, SPEED OF CLOSURE, MEMORIZATION) 

ProbablMty Monitoring - Four semi-circular scales located along the upper portion of ihe expenmenial 
panel are used to display the probabiKiy monitoring task. The subject's task is to delect a bias (movement 
of the pointer in the center to either the right or the left) by pressing a button under the meter with the bias. 
Data recorded include number of biases presented, the number of bias signals correctly delected, ihe 
number of false alarms and the response time. (TIME SHARING, seme performance strategies may utmze 
PERIPHERAL VISION) 

Target identification • In the center of the subject's panel, there is a six-by-six matrix of close-bulled 
square lights. Metric histoforms are created by using lit and unlit lights. The subject is typically presented 
with a five second display of the target image followed by a five second off period. There is a two second 
display of a randomly positioned (rotated) choice image, a two second off period, and a two second display 
of a second choice image. The response period is fourteen seconds. Each subject is requirec: to respond 
by pushing one of three buttons to indicate that the first, second, or neither choice was the same as the 
target original. A blue light indicates a correct response above the appropnaie button. (PEPOEPFUAL 
SPEED. MEMORIZATION, VISUALIZATION) 

Warning Lights Monitoring - The subject is presented with a pair of warning lights, one red and one 
green. The normal state is depicted by green-on, red-off. The subject is required to detect any change ,n 
state, and to respond by turning the green light on if it goes off. or turning the red light off if it comes on. 
The subject responds by pressing a push button located immediately below the light m question. Laienv./ 
data are transformed to normalized speed scores. If the subject does not respond within two minutes, 
he/she will receive the maximum latency score. (RESPONSE ORIEN TATION) 



37 

47 



NTSC TR86-020 



Naval Blodynamlcs Laboratory Computerized Cognitive Testing (Naval CCT) 

Irons, R. & Rose, P. (1985). Naval biodynamics laboratory computerized cognitive testing. 
Neurobehavioral Toxicolog y and Teratologv . Z 395-397. 



The Naval Biodynamics Laboratory has developed a network system of microcomputers to test subjects 
within a laboratory setting and within jnusual environments (e.g., impact acceleration, vibration endurance 
testing, ship motion simulation). A NESTAR network configuration permits the sharing of test programs 
and data bases between any of the test stations. This allows testing to be conducted concurrently 
between test sites in a time-sharing mode. 

A description of the task selection process for this project and of several studies carried out usmg these 
tests (including paper and pencil versions) is described by Harbeson, Bittner, Kennedy. Carter, & Krause 
(1983). 

Hardware 

The required hardware includes an Apple II (48K RAM) or Apple lie. Mountain Hardware Superlalker, 
Mountain Hardware Clock/Cahndar Card, LPS II Light Pen by Gibson Laboratonec, two 5 1/4" disk drives, 
an Apple II compatible printer, an Advance Business Technology Keypad or Apple lie Keypad, and a three 
button response box. 

Software 

A number of utility programs are included to aid in setting parameters for particular tests, in data 
management on stand-alone or network arrangements, and in data analysis. Generally, data for individual 
subjects is accumulated and stored in data files named for the task or subtask. These data files are DOS 
3,3 text files. Utility programs include a CLEAR program to delete data from a data file without deleting the 
textfile from the direoory, a CREATE program to set-up main data files and temporary data file buifers (for 
network systems), and a set of READ programs to allow transfer of data from all or part of individual data files 
to screen, printer, analysis program, etc. 

Task Descriptions 

Auditory Digit Span Task - This task relies on the Super Talker to warn the subject that the tnal is 
about to begin ("Ready"), and then presents a series of digits followed by a bell. On hearing the bell, the 
subject enters the series using the keypad. As soon as the correct number of digits is entered, the 
stimulus series and the answer are shown on the screen. If the response is correct, another digit is addtJd 
to the next series to be presented. If incorrect, the series is decreased by one. A second version of this 
test follows the same procedure except the length of the series remains constant. (SPEECH HEARING. 
MEMORIZATION) 

Choice Reaction Time Task - This task has two parts, a pre-test and a post-test, both using the same 
paramete'-s. One of three versions is selected (i.e., two-button, three button or four-button reaction time). 
The experimenter selects a digit from one through nine as the stimulus for each button. A random 
stimulus is presented and the subject responds by rapidly pressing the corresponding button. Feedback 
is in the form of tones. One of five tones is presented to indicate the speed of respor se on a scale ranging 
from very good to very poor. The procedure is repeateo until the trial or test limit set Ly the expenmenter is 
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Choice Reaction Time Task (cont.) 

reached. The post-test is then given until the critenon is reached again. (RESPONSE ORIENTATION) 



Code Substitution Task - In this task, a random ordering of nine digits is paired with randomly drawn 
letters (from A-2). A single letter from the set is shown above the coded pairs of letters and numbers. The 
subject then enters the appropriate digit for the letter displayed. The sequence repeats until the time hmit 
for the test has been reached. (PERCEPTUAL SPEED) 

Logic Task - This task uses the CRT to present afour-by four matrix of sixteen boxes having a 
preassigned number sequence. The object of the test is to learn this sequence. The subject enters a \ 
box number via a numeric keypad. This "shades" the box (removing its number). If any previously 
selected boxes actually occur later in the sequence, they revert to their original dtsplay. The subject 
should leam that the number just entered comes before those that were renumbered. The number of 
setbacks and the time to complete the sequence are taken as data. (INDUCTIVE REASONING, 
MEMORIZATION) 

Manikin Task - This task presents an image of a sailor holding a blue box in one hand and a red box m ihc 
other. The sailor stands on a box that matches the color of one of the boxes in the sailor's hands. The 
saibr may appear right-side up, up- side down, and facing either toward or away from the subject The 
subject indicates as quickly as possible the hand in which the sailor is holding tt o box that matches the 
base, by pressing a key with the left or right hand. The number of 16-triaI blocks is pre selected by the 
e.(perimenter. (VISUALIZATION, RESPONSE ORIENTATION, VISUAL COLOR DISCRIMINATION) 

Math Test ^ The subject is first presented with addition, subtraction, multiplication, or division signs that 
are labeled for clarification. For each problem, a four-digit number is presented on line one and an 
arithmetic sign and a single digit is presented on line two. The subject pert^.ms the indicated mathematiCd. 
operation and responds on an external numeric keypad. The test continues for a set number of trials. 
(NUMBER FACILITY) 

Maze Task - The Maze Task requires the subject to move a dot through a maze (pr sented on a CRT) Dy 
controlling a joystick. The task is completed when the dot reaches the exit point. (CONTROL PRECISioN, 
FINGER DEXTERITY) 

Pattern Comparison Task This task involves the presentation of two patterns simultaneously, with 
both left-hand and right-hand patterns occupying a space of 120(w) by 177(h) pixels. Patterns are 
enclosed inside borders that form a continuous box. There are eight randomly selected x, y 
coordinates for each pattem. If the patterns are not identical, they differ by at least three pixels. The 
subject must push the button marked "same" or the button marked "different !o end the tnai. ^he test 
continues for a previously determined time limit. (PERCEPTUAL SPEED) < 

Spoke Task - The CRT display used for this test consists of thirty two individual ciicies equally spaced 
around a circumference and one circle in the center. The circles each have a white hg.it m the center which 
may bo illuminated. Initially, the center circle is lighted. The subject taps the hghied cei.ler circle with the 
light pen. This 'ight \^ extinguished and one outside circle light is illuminated. When the b jbject tapo this 
light, it is ertinguished and the center light is illuminated once more. When the subjects taps the center, 
the cycle is repeated, with the next sequential outside circle being lighted. This cycle is repeated until the 
subject has gone all the way around the outside circles in a clock wise direction. (MANUAL DEXTERITY) 
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Sternberg Memory Scanning Task This test program randomly selects target numbers (one to four 
digits in length) and displays these numbers for one second. The display is then cleared for a two secofij 
retention interval, after which a single digit is presented. The subject is to indicate if this digit was or was 
not in the target group. This task continues for the interval set by the experimenter. {PERCEPTUAL 
SPEED, MEMORIZATION) 

Stroop-IIke Color Naming Tasks - There are three versions of this test, each of which uses the words 
RED, BLUE and GREEN as stimuli. In Version One. the words are randomly selected, plotted and 
presented on the screen as white stimuli on a dark background. The subject is to respond by pushing the 
red, blue or green button. Version Two presents the words as red, green or blue stimuli (e.g., the word 
RED printed in bLe). The subject is to respond to the meaning of the word instead of the color in vvhich 
the word is printed. Version Three is presented in the same fomnat as Version Two. The subject is to 
respond to the color of the stimuli instead of the meaning of the word. All tasks continue until an 
experimenter-designated time limit is reached. (SELECTIVE ATTENTION, RESPONSE ORIENTATION, 
VISUAL COLOR DISCRIMINATION) 

Visual and Auditory Grammatical Reasoning Task In this test, a series of sente»^ce picture pairs 
is presented. The sentences are in the form of ''A (dot^ not) precede(s) B", the pictures are an "A" and a 
"B" in either order. The subject responds with T if th« sentence-picturo pairs match and T" if they do not 
match. The visual version presents the stimuli on the CRT screen, while the auditory version presents 
them via the Mountain Hardware Super Talker device and earphones. (DEDUCTIVE REASONING. 
SPEECH HEARING. WRITTEN COMPREHENSION) 

Visual or Auditory Serial Addition Task ■ This task has two versions. The adaptive version allows 
subjects to input responses at their own pace. If the response is correct, the length of time to respond i., 
decreased by a specified amount. If the response is incorrect, the length of time to respond is increased 
by the same amount The constant version allows the subject only a specified length of time to mpiii a 
response, "^he test itself is comprised of a random number between one and eight being plotted on the 
CRT or being spc';on thro jgh the Super Talker. This is followed by a retention inten/al and the 
presentition wf a S2cc .d .umber bettveen one and eight. The subject is to mentally add the two digits 
and iiien input tna sum ,;a the numeric keypad. (NUMBER FACILITY. MEMORIZATION. SPEECH 
HEARING) 
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Neurobehavloral Evaluation System (NES) 

Baker, E. L., Letz, R. E., Fidler, A. T., Shalat, S., Plantamura, D. & Lyndon, M.A. (1985). Computer-based 
neurobehavioral evaluation system for occupational and environmental epidemioiogy. Meinodology and 
validation studies. Neurobehavi oral Toxicology and Tfiratoiopy . J, 369-377. 



A computer-administered neurobehavioral evaluation system (NES) was developed to evaluate 
populations at risk for nervous system dysfunction due to environmental agents. The development ul Uiis 
test battery was influenced by previous tests developed for use in epidemiologic investigations. 
Additionally, a committee convened by the World Health Organization (WHO) and the National msiilule lor 
Occupational Safety and Health (NIOSH) have proposed a core set of neurobehavioral tests for use in 
epidemiological studies. Most of the tests are adaptations of pre-existing clinical instruments. The 
selection of tests was guided by clinical and epidemiologic experiences as opposed to theoretical 
considerations from the field of cognitive psychology. 

This battery is comprised of twelve separate tasks. The tests evaluate verbal ability, psychomotor 
functioning, memory, visual spatial ability and mood -parameters which are potentially altered by exposufe 
to neurotoxic agents. Combinations of the tests can be used or a standard administration sequence 
adopted. Five of the tasks in the battery a.e ^i.nilar to tests within the seven-test WHO core test battery 
(Worid Health Organization, in press). symbol<iigit substitution, digit span, simple reaction time, the visual 
memory test, and the mood scale. Additionally, a verbal palred-associate leaming test and a continuous 
perfomnance test have been specified by the WHO group as suitable supplements to the core set. 

Prior to testing, each person completes a detailed work-health questionnaire regarding prior health 
conditions, prior jobs ani ;::b-related chemical exposures, current and past habits (e.g., alcohol and 
cigarette consumption history}, demographic information, and current symptoms. The questionnaire is 
reviewed f jr aucuracy and completeness by an interviewer. Immediately before administration of trie test 
battery, a pre test questionnaire designed to evaluate transient conditions (e.g.. physical injunes, aicohoi 
or drug consumption, sleep deprivation, emotional trauma) is also administered. 

Hardware 

The IBM PC was used for test development and initial administration. The programs will run on several IBM 
PC compatible machines including the COMPAQ. A joystick control having two pushbuttons is required 
for some task inputs. 

Software 

The software that administers these tests is written in IBM's Advanced BASIC. Separate files are 
developed for each subj\3ct and contain identification data and the test results. Each test m the battery is 
individually administrable. A screen menu pemnits the interviewer to choose the tests and test order lor 
each subject. Timing of response latencies is accomplished by a software clock. Standard 
communications software pennits data transfer over telephone or dedicated communication lines to larger 
computers for analysis using standard statistical software packages. 
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Task Descriptions 

Continuous Performance Test (CPT) This test measures sustained visual attention by having the 
subject press a button upon seeing a large letter "S" when it is projected onto a vdeo display terminal. 
Letters flash briefly (for about fifty msec) on the screen at a rate of one per second for five minutes. 
Recording and storage of individual response latencies allows for computation of mean and standard 
deviation of reaction times by minute and for the full task. Omissive and commissive errors are also 
recorded. Using this data, indices of speed, task learning, and attention can be derived. (PERCEPTUAL 
SPEED, REACTION TIME) 

Digit Span - The auditory version of this widely-used clinical teot is part of the Wechsler Adult Intelligence 
Scale and Wechsler Memory Scale. In the NES version, the subject must enter into the computer 
progressively longer series of digits which have been presented visually at a rate of one per second b> the 
computer. New digit sequences are created at each span length. After incokrectly responding to two 
at a span length, the task changes such that the subject must enter digits in an order reversed from that 
presented by the computer. Previous studies of solvent and lead toxicity have utilized this test as a 
measure of short-term memory and attention. (MEMORIZATION) 

Hand-Eye Coordination Test This test requires the subject to use a joystick to trace over a large 
sine wave pattern on the video display terminal. The computer owves a cursor horizontally at a conSiarit 
rate, while the individual controls the vertical motion of the cursor with the joystick. Deviations from a sd 
line as mean absolute en-or and root mean square error are recorded and constitute measures of 
coordination ability. This task evaluates dexterity, a function found to be disrupted in previous studies of 
various neurotoxic agents. (CONTROL PRECISION, FINGER DEXTERITY) 

MemoP/ Scanning Test The subject is shown a series of digits and ilien must indicate whether a le. 
digit comes from the previously presented set. Responses are scored as correct incorrect and response 
latencies are recorded. The set size of digits to be presented is varied from two to five and regression 
techniques are used to assess cognitive encoding and motor processing, positive and negative latent), 
and memory scanning time. The test measures the actual processing time required to recall previously 
stored (i.e., learned} information and has been shown to be sensitive to chronic mercury exposure. 
(MEMORIZATION. PERCEPTUAL SPEED) 

Mood Scales - Subjects are asked to rate their feelings over the previous week on each of twenty fue 
adjecuves or phrases. By combining ratings, these twenty-five individual items yield a five dimensjonai 
mood profile. Prior studies of lead toxicity have shown that such an approach is useful and sensitive \u the 
evaluation of central nervous system effects of occupational lead exposure. 

Palred-Assoclate Learning Test (with delayed recall) - This task is similar lo the Digit Span task, ar^: 
is designed to evaluate short-temn verbal memory. Word pairs are read from the visual d:;>^!ay screen at a 
rate controlled by the computer. The series of words is presented three times with varying mternai o. 
Scores, consisting of the number of correct associations, are given for each tnal. An additional tnai 
containing the same words is given at the end of the testing session to evaluate memory encoding and 
intemiediate recall. (MEMORIZATION) 

PaJtern Memory Test - TK short-term visual menfX)ry involves the brief piesentation of a 

block-like pattern sir" < . i;>ed in the pattern recognition test followed by three similar figures, on*, 
of which is Identical .o ...^ . , p^^ttem. The degree cf correspondence of the two incorrect patterns to 
the correct one varies. (M! v^.... IK PERCEPTUAL SPEED) 
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Pattern Recognition Test - This task requires that the subject identify ,\Uich of three block like 
patterns differs from two other figures which are identical. The task requires intact visual organisation 
ability, a function which is required for the perception of complex visual material and which represents an 
aspect of higher cortical function. (PERCEPTUAL SPEED) 

Simple Reaction Time This task requires the individual to press a button when seeing a large "0" on 
the screen. The interstimulus interval is varied randomly between 2.5 and 7.5 seconds to reduce 
anticipation effects. Data are recorded as individual reaction times over the presentation of Sixty stimu!. ar^a 
the response latencies are averaged over blocks of twelve trials. (REACTION TIME) 

SymboI-DIgll Substitution Test - This task is similar to the Digit Symbol Substitution test from the 
Wechsler Adult Intelligence Scale (WAIS). The Digit-Symbol test, which 3valuates speed and coding 
abilities has been found useful in prior epidemiologic studies of individuals exposed to lead, carbon 
disulfied, and solvent nitxtures. Nine symbols and digits are paired at the top of the scree.* and the subject 
has to press the digit keys corresponding to a reordered test set of the nine symbols. The Ime required to 
complete each symbol digit set and the number of digits incorrectly matched are recorded. Five sets of 
nine symbol-digit pairs are presented in succession. The pairing of symbols with digits is varied between 
sets to avcid leaming. (PERCEPTUAL SPEED) 

Visual Retention Test - The machine first presents a test figure followed by four similar figures from 
which the individual must select the figure previously seen. The score consists of the number correct and 
the average response time for correct and inconect responses. (PERCEPTUAL SPEED) 

Vocabulary Twenty five words are presented and the subject is asked to select the synonym from a set 
of four words. This test is said to provide a stable index of CNS function. (WRITTEN COMPREHENSION; 
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PORTA-BAT, Version 4 

Basic Attribt js Tests (B AT) - Vers'on 4 Hardware System. & Indivduq! Tec! Descriptions Hune. 19S5, 
Brooks AFB. TX. U.S. Air Force Human Resources Laboratory Manpower and Personnel Division, 



In 1983. the Air Force Human Resources Laboratory decided to replace the older Bas.o Attributes Tests 
(BAT) and testing stations with modern, high speed super microcomputer driven, transponable testing 
units. The Porta Bat is a complete, integrated, portable testing and training lalx)rator> being validated by 
AFHRL. The battery is designed to measure a variety of information processing abilities and personality 
characteristics that are considered important in selecting flight training candidates. 

Hardware /Software 

The PORTA-BAT features high speed graphics, rugged single and two axis joysticks, data entry keypad, 
fixed and removablahard disk drives, and a rugged station enclosure. The station enclosure is, a -^ j; tool 
heavy guage aluminum enclosure with doers on the front and the back. The desk top cabinet slides i.ito 
the station enclosure on rails and is fastened in place. The front doors open 9C degrees and a top pan^i 
slides out to form a visual screen to both sides and above the subject. A lower panel hinges out to the 
floor and leg positioners precisely fix the location of the chair provided with the unit. Two mdusinal quality 
joysticks with precision potentiometers are included as part of the system. The total weight of the 
complete unit is under three hundred pounds. With a suitable transformer the ^'ORTA-BAT may be use i 
with 220 volts and 50 Hz in addition to the standard 120 volts and 60 Hz electricity. 

The PORTA-BAT features a powerful super microcomputer v\^ith very high speed, high resolution graphics 
and ...Tiunications features that permit networking or on line data transfer to a monitoring station during 
testing. Since the operating system is a direct adaptation of UNIX and most standard compilers are 
available with the PORTA BAT, software may be developed by in-house personnel to perform desired 
lesting/lraining capabilities. The POPTA-BAT Supports serial or parallel prinltjio and up to three additional 
terminals for concurrent program development, general purpose computing, or analysis of test data. 
PORTA-BAT comes equipped with a high level graphics software package with C and FORTRAN callable 
graphics functions, the Regulus operating system, a C compiler, a FORTRAN compiler, and ^he software 
necessary for interfacing all attached devices. 

The system was built around the Motorola MCb8010 processor and REGULUS, a real-time 
UNIX-compatable operating system. From a basic computer commercially offered by Aicyon Curporation, 
Technical Solutions, Inc, (TSI) developed a custom computer that performs the laboratory functions. The 
processor, a model APS, was first configured with both a five Megabyte fixed hard disk and a five 
Megabyte rermvable diskcartridge so that the operating system and the permanent software arc re.^J^jrii 
on the system, and data gathered may be easily transported via the rennovable disk. The processor 
memory was increased to 512 Kilobytes to accomodate the graphics sofNvare and large applications 
program. A graphics co-processor was added so that the graphics vector stroke generation was oilioaJed 
from the main processor, allowing for increased functional capability in the main processor and faster 
graphics display generation. This co processor was installed on an intc.nal Q-BUS and appears as a 
peripheral to ihe main processor. The video section of the CRT display was modified to operate m eiiner a 
graphics mode or alphanumeric mode under software control. A parallel input-output board and an 
Ara'og to rigital converter were added to the Q-BUS together wu/ 1 custom designed TSI addpter driver 
board The parallel input/output board allows for sixteen inputs and sixteen outputs of TTL logic le/€ to 
the computer. It is used in the PORTA-BAT for control of the lights in the keypad, keypad respor s 
sv/itch inputs from the two axis joystick, and the generation of interrupts. The ADC is used for th^a 
measurement of joystick movement. Thirteen additional channels exist for custom applications and 
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application-specific requirements, "^he adapter driver board provides signai routing. Signal conditioning, 
and interfacing functions as well as ti<e generation of **pink" noise to drive a headphone. The noiSe ibvel 
may be set by on-board adjustments, and is used together with the PORTA BAT headphone set to 
eliminate background sound distractions. 

The graphics display of the PORTA BAT is a 481 X 530 monochrome display with four image planes and 
grey level capability. Capable of drawing over 40,000 vector strokes per second, the graphics processor 
produces twenty full-screen updates per second refreshed at 60 Hz. 

Task Descriptions 

Note: The bracketed terms represent the original author's designation of the "psychological factors" 
measured in performance of the task. 

Activities Interest. Inventory [Survival attitudes] The subject is presented with eighty one pairs of 
activities and is asked to choose bi3tween them. The task is designed to sample the subjects interest .n 
various activities. The subject is told to assume he/she has the ability 'necessary for each activity. 

Automated Aircrew Personality Profiler [Personality factors to be extracted] This task examines 
the subject's attitudes and intere' s and is targeted for aircrew work. The subject is presented with 200 
questions, each requiring a choice between two alternatives. The subject is instructed net to spend l^mti 
pondering, but to give the first, natural answer as it comes. 

Decision-Making Speed [Simple choice reaction time] The subject is presented with one of a 
number of alternative signals. The subject must respond to the signal with the matching response as 
quickly as possible. Task difficulty increases when more alternative signals may potentially be presented. 
There are four subtasks within the main task. (RESPONSE ORIENTATION) 

Dot Estimation [Compulsiveness vs. Decisiveness] • The subject is presented with two boxes 
containing an arbitary number of dots. One of the two boxes has one more dot than the other. The 
subject's task is to detennine as quickly as possible which of the two boxes has the greater number of 
dots. (PERCEPTUAL SPEED) 

Embedded Figures [Fieic dependence/independence] • The subject is presented with a simple 
geometric figure and twj complex geometric figures. The subject's task is to decide which ot the two 
complex figures has the simpler figure embedded within it. The subject indicates the choice Dy prebSing a 
button corresponding to that figure. (FLEXIBILITY OF CLOSURE) 

Encoding Speed [Verbal processing ability] - The subject is presented with two letters. S/he is 
required to make a same/different judgment on the letter pair based on either physical identity (ex. AA vs. 
Aa) or name identity (ex. AA vs. AH). The latency of the encoding judgment provides a measure of ine 
speed of the encoOiiig process. (PERCEPTUAL SPEED) 

Immediate/Delayed Memory [Continuous short lerrr. memory storage and retnevai] The subject is 
presented with a sequence of digits and is required to press a button corresponding to the item which 
occurred one or two digits previously. First, the digits are presented for O.S seconds followed Dy a two 
second interstimulus interval. Then, the digits are presented followed by a five second inters' muius 
interval (PERCEPTUAL SPEED, MEMORIZATION) 
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Item Recognition [Short-term memory store, search and compare operations] A row of one to six 
digits is presented on the CRT. After a brief delay, a single digit appears on the screen. Subjects are 
instructed to remember the initial series of digits, then to decide if the single digit is one of those 
represented in the initial series. The subjects respond by pressing either a "yes" or "no" button. 
(PERCEPTUAL SPEED, Mbl\/10RIZATI0N) 

Mental Rotation [Mental-spatial transformations and classification] - The subject is sequentially 
presented with a pair of letters and asked to make a speeded same/different judgment. The letter pair may 
be either identical or min-or-images, and the pair may be in the same or different spatial orientation. 
(VISUALIZATION, PERCEPTUAL SPEED) 

Perceptual Speed [Information input efficiency] • The subject is presv^nted with a sequence of four 
digits and is required to respond by pressing response pad buttons in the same order as the presented 
digits. (PERCEPTUAL SPEED, RESPONSE ORIENTATION) 

Psychomotor Device Tesis [Low to moderate order tracking, time sharing ability] - The first subtask i& 
a two-hand coordination task. The subject controls the vertical and horizontal movement of a small cross 
using the left and right joy sticks, respectively. In the second subtask, which assesses complex 
coordination, ihe subject uses a dual axis joystick to control the horizontal and vertical movement of a smaii 
cross. The subject's task is to keep the small cross centered on a large cross fixed at the CRTs center, 
while at the same time centering the rudder bar at the base of the C ,T. (CONTROL PRECISION, FINGER 
DEXTERITY, TIME SHARING, MULTILIMB COORDINATION) 

Risk Taking [Effects of uncertainty on decision-making] - The subject is presented with a mainx of ten 
boxes (in two rows of five) and is told that nine of the boxes contain a reward and one is a disaster box. The 
subject selects one box at a time. If the selected box conlains a payoff, the subject gets to keep it. If the 
disaster box is selected, the subject loses all of the payoffs acquired. The average number of boxes 
selected provides an index of the subject's propensity for taking risks when making decisions. 

Self-Credlting Word Knowledge [Self-assessment ability/self-confidence) - The subject is 
presented with a "target" word and five other words. The subject must choose which one of the five words 
means most nearly the same as the "target". There are three blocks of ten questions each and the target 
words become increasingly more difficult with each succeeding block. The subject is informed of this 
difficulty and is required to make a bet prior to each block, which reflects how well s/he expects to do. 
(WRITTEN COMPREHENSION) 

Task Battery Introduction - This is an interactive subprogram which collects such information as the 
subject's identity, age, gender, personal history, anJ -attitudes about flying. 

Time Sharing [Higher order tracking] - The subject must anticipate the movement of a marker on a visual 
display and operate a control stick to counteract the movement and keep the marker aligned v^ith a Iiacu 
central point. After a fixed number of trials, the subject is then required to track while cancelling digits 
which appear at random intervals and locations on the display. S/he cancels the digits by pressing the 
corresponding buttons on the keypad. The d'»al task trials occur it. two blocks of three tnals each which are 
then followed by additional tracking-only trials. (TIME SHARING, RATE CONTROL, FINGER DEXTERITY) 
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Taskmaster System - NIOSH Performance Battery 

Wheeier, D.D.. & Rosa. R. (1984). Instructional manual. Taskma ster Svstfim / NIOSH Pfirfnrmanrp 
Battsry. Version 1984 July 2Q Cincinnati. OH: National Institute of Occupational Safety and Health. 
Division of Biomedical and Behavioral Sciences. 



The Taskmaster system is a set of microcomputer programs designed to administer a battery of 
performance tasks to a human subject without the presence of an experimenter. The Taskmaster system 
can be set up to administer any subset of the available tasks. The tasks can be adjusted for the specif tc 
requirements of the study being conducted. For the Grammatical Reasoning task, for instance, both the 
difficulty of the iter c and the number of blocks of trials can be specified. 

Taskmaster is intended for applications involving repeated testing of subjects over an extended period of 
time An example would be a study of the effects of different work schedules. Subjects would be able to 
administer the t-^st battery to themselves both before and after work. 

Hardware 

The Taskmaster system is designed to run on the Kaypro II microcomputer. The system uses software 
loops for timing, calibrated with a 2.5 MHz CPU clock. The programs will have to be recalibrated if the 
system is to be used on the newer Kaypro II. The Taskmaster requires two hardware accessories. (1) a 
clock/calendar, and (2) a custom designed accessory box with various features and items, including the 
following: a) threj push buttons for obtaining timed responses froin the subjects, b) a white noise 
generator with output to headphones, and c) a probe with a metal ti|. and a metal opening slightly larger 
than the tip. 

The NIOSH Performance Battery is currently being re-written for IBM compatible computers. 
Software 

The Taskmaster system is supplied free upon request. Two blank disks must be sent to the authors in 
order to copy ihe NIOSH software. 

Task Descriptions 

Arithmetic Speed - This task consists of a series of single digit addition problems. The subject is only 
required to type in the last digit of the sum. The task is subject paced. The expenmenter can increase the 
difficulty level by specifying an optional single digit constant. This constant is presented briefly (ttiree 
seconds) to the subject before the series of trials. The subject must then add this constant to the sum on 
each trial The task lasts for a specified amount of time rather than a fixed number of tnais. Elapsed time, 
trials completed, and number of errors are recorded. (NUMBER FACILITY. MEMORIZATION) 

Free Recall of Word List • This task presents d i;st of words to the subject, one at a time, and then 
tests free recall memory by requiring lis subject to type them on the keyboard. A time limit for recall can be 
specified by the experimenter. The program counts the number of words correctly recalled bv the subiect 
(MEMORIZATION) / J • 
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Grammatical Reasoning • This task measures the subject's speed and accuracy on a complex task 
involving both memory and reasoning. For each trial, the following sequence occurs. 1) a stimulus suing 
of letters (e.g., JLN) is displayed for two se.:onds, 2) the screen is cleared for ajhree second retention 
interval, then 3) a test statement appears on the screen (e.g. N precedes L), and finally, 4) the subject 
indicates whether the test statement is TRUE or FALSE by pressing the appropriate button. Incorrect and 
non responses are counted as errors. Means and standard deviations of reaction times are reported tor 
each block of sixteen trials. (DEDUCTIVE REASONING, MEMORIZATION, WRITTEN COMPREHENSION; 

Grammatical Reasoning with Reaction Time ♦ This task consists of the Grammatical Reasoning task 
with a simultaneous auditory reaction time task. The dual task's only difference from the Grammatical 
Reasoning task is that the subject is instructed to put on the headphones during the task and lo push a 
button whenever a noise burst occurs. (DEDUCTIVE REASONING, TIME SHARING, REACTION TIME, 
WRITTEN COMPREHENSION) 

Hand Steadiness • This task requires the subject to hold the small metal tip of a probe withm a small (1/8 
inch) metal fitting. The subject's goal is to minimize the contact between the probe and the fitting. The 
program records the percentage of time in contact. (ARM-HAND STEADINESS) 

Noise Fusion ^ This task estimates the detection threshold of a silent gap between two noise pulses. 
Trials are presented to the subject through headphones. On each trial, the program presents two noise 
bursts (about 108 ms long) separated by a gap of silence. If the gap is short enough, the subject hears the 
two bursts as a single longer burst. The subject is to indicate after each trial whether they heard one or two 
bursts. (GENERAL HEARING) 

Questionnaire Tests • This program can administer questionnaires consisting of multiple choice or 
rating-scale items. It can also ask open ended questions or those requiring numeric responses, such as 
temperature. 

Reaction Time - This program can present three different kinds of reaction time tasks. 1) simple visual 
reaction time, 2) choice visual reactfon time, and 3) simple auditory reaction time. Means and standard 
deviations aic reported for each block of trials. (REACTION TIME, RESPONSE ORIENTATION) 

Response Alternation - This task measures the speed with which the subject can alternate between 
pushing two buttons. When the subject begins pushing either button, the program counts the number of 
alternations {press and release of each of the two buttons) until the end of the time penod. (FINGER 
DE)CTERITY) 

Time Estimation ♦ This task requires that the subject indicate when a specified number of seconds have 
passed. The subject is instructed not to count during the interval. The program first tells the subject the 
length of time to be estimated. The subject pushes the "press" button to begm and terminate intervals 

Zip Code Typing This task was designed to simulate a boring and repetitious work environment. Tne 
program randomly generates five digit numbers and displays them, and the subject must simply type m the 
digits. Immediate "OK" or "Error" messages are displayed for each trial. If the subject's accuracy is below 
ninety percent, the program displays the message "Please try harder". (SELECTIVE ATTENTION) 
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Unified Trl-Servlces Cognitive ^nce Assessment Dattery (UTC-PAB) 

Englund, C.E., Reeves, D.L., Shingledecker, C.A., Thome. D.R., Wilson, K.P., & Hegge, F.W. (1986). 
Unified Tri-Service Coonitive Performannft Assessmft pt Batterv aJTC-PAm * 

* Our report is based on a pre-publication document supplied by Dr. William Perez of Systems Research 
Laboratories of Dayton, Ohio. 

The purpose of this battery is to provide a standardized metric that is responsive to required 
military-mission abilities and skills and that will be a sensitive instrument for detecting performance 
decrements due to the use of biomedical treatment dmgs. 

Tasks comprising this battery are largely derived from components of the Army (WRAIR-PAB), Navy 
(PETER; NAVAL CCT) or Air Force (CTS) batteries detailed elsewhere in this report. UTC-PAB should be 
available for use in early 1987. 

Hardware/Software 

The UTC-PAB \z currently written for IBM compatible computers in C language. Although no formal 
descriptions of special hardware are yet available, use of the UTC-PAB is anticipated to require such 
response devices as a button box, key pad, hand-held push button switch and rotary knob. 

Task Descriptions 

Note- Ta.k descriptions include mention of a "construct" proposed by the UTC-PAB authors in addition to 
the ability/abilities designation assigned by the current authors and parenthetically detailed for each task. 

Aipha-Numerlc Visual Vigilance Task - Construct, vigilance [sustained choice RT] - Random 
alphabeti'^ characters or numbers are presented at random intervals ranging between six and fourteen 
seconds. Subjects press a hand-held, push button switch whenever an "A" or "3" appears 
(PERCEPTUAL SPEED. RESPONSE ORIENTATION) 

Code Substitutions - Constructs, perceptual speed/associative leaminy ability - This test is denved 
from a paper and pencil test contained in the Wechsler Adult Intelligence Scale. The subjects see a string 
of nine letters and a string of nine digits displayed across the screen. The strings are arranged so that tne 
digit string is immediately below the letter string with one digit corresponding to each letter. A test iett<^r is 
presented at the bottom of the screen and the subject is to indicate which digit corresponds to the test 
letter in the displayed study strings by pressing the appropriate response button (PERCEPTUAL 
SPEED) 

Continuous Recall Task Constructs; encoding and recall/working memory - This task indexes the 
operator's ability to encode and store information in working memory. It requires serial encoding and recall 
under a changing memory state. The memory test consists of a random series of visual presentations of 
numbers which the operator must encode in sequential fashion. As each number is pre.sented for 
encoding, a probe number is simultaneously presented. The ope Hor must compare this probe nunsber 
to a previously presented item at a [:-e-spec;fied number of positions back in the series and indicate it that 
item is the same or different from the probe number. (PERCEPTUAL SPEED. I\/IEI\/IORIZATION) 
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Dichotic Listening Task ♦ Construct, auditory selective attention • This task requires subjects to 
attend to auditory information (a specific set of letters and digits) presented to one ear while ignonng sirrnidr 
information presented to the opposite ear, and then after considering an auditory cue, to switch attention 
rapidly to the previously unattended ear, or maintain attention to the previously attended ear channel. 
Subjects must attend to auditorily presented information and respond to the numbers presented on the 
command ear channel using a keypad. The numbers are touched jn the keypad I.n the order of their 
occurrence in the command ear. (AUDITORY ATTENTION, SELECTIVE ATTENTION) 

Four-Choice Serial Reaction TImw Constructs, encoding, categorization, response selection and 
execution - This task presents a blinking ' us sign) imposed on the cursor in one of four quadrants ol 
a CRT. The subject presses one of four keys, each corresponding to one of the four quadrants, to 
indicate the location of the blinking "+". (RESPONSE ORIENTATION) 

Grammatical Reasoning (Symbolic) Construct, logical reasoning • Stimulus items are sentences of 
varying syntactic structure accompanied by a set of symbols (e.g. *,@, #) presented simultaneously. The 
sentences must be analyzed to determine whether they correctly describe the crdenng of the symbols m 
the symbol set. Task demand is influenced by the amount and complexity of grammatical analysis. 
(DEDUCTIVE REASONING) 

Grammatical Reasoning (Traditional) - Construct, log^ca; reasoning * This a linguistic task requmng 
knowledge of English grammar and syntax, and the ability to determine whciher various simple sentences 
and their grammatical transformations correctly describe the relational order of two objects. On each tnai 
the letter pair "AB" or "BA" is displayed along with a statement that correctly or incorrectly describes the 
order of the letters within the pair. The subject decides as quickly as possible whether the statement is 
true or false and presses the corrcsct button on the button box. (DEDUCTIVE REASONING, WRITTEN 
CONPREHENSION) 

Interval Production Task • Construct: response timing • This task requires subjects to generate a 
series of time intervals by tapping a finger key at a rate of one to three responses per second. The goal ot 
the task is to maintain equal ♦Jmt intervals by tapping at as regular a rale as possible. (FINGER DEXTERITY; 

Linguistic Processing • Constmct. visual/verbal-phonetic coding - This task is a synthesis of letter 
matching and genenc depth of processing tasks. It is a standardized loading task that places demands on 
resources concerned with processing and transformation of linguistic information, and requires 
classification of letter or word pairs. Letter or word pairs are presented on a CRT, and subjects are 
instructed to respond "Same" if the items match on the dimension in question or "Different" rf otherwise. 
There are three levels of task demand: (1) physical letter match - in which letter pairs must be physically 
identical to match (low demand), (2) category match - requiring that both letters be either consonants or 
vowels (moderate demand); and (3) antonym match - in which only words opposite m meaning consiauie a 
match (high demand). (PERCEPTUAL SPEED, INDUCTIVE REASONING for antonyms) 

Linguistic Processing-Choice Reaction Time Combination - Construct, time shanng ability - 
This "dual task" paradigm represents the combination and simultaneous presentation of the Linguistic 
Processing Task (Category Match) and the Four-Choice Reaction Time Task. The same stimuli used in 
single-task conditions are used in this combination with the resirictions noted. (RESPONSE 
ORIENTATION, TIME SHARING, PERCEPTUAL SPEEL, INDUCTIVE REASONING for antonyms) 
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Manikin Test - Constmcts; spatial orientatioa'rotation ability - This test uses high resolution graphics to 
display a sailor holding a blue box in one hand and a red box in the other hand. The sailor stands on a base 
which is a rectangular box (red or blue) that matches the color of one of the boxes m the sailor's hands. A 
display of the sailor and base may appear right side up. upside down, front facmg the subject, or back 
facing the subject. At the bottom of the base "4-left" and "'^ ight" are printed to indicate the keys that 
represent left and right. If the subject thinks the box in the sailor's left hand matches the color of the base, 
s/he responds left, and vice-versa if the match is on the sailor's right side. (VISUALIZATION, VISUAL 
COLOR DISCRII^/IINATION) 

Mathematical Processing Task • Constructs, number facility/general reasoning - This is a loading task 
that is designed to test information processing resources that are concerned with arithmetic operations 
and value comparisons of numeric stimuli. Subjects perfonn one or more addition and/or subtraction 
operation? on visually oresented single digit numbers. Subjects respond on a two button keypad to 
indicate whether the total is greater or less \hu . the pre-specif:ed value of five. (NUMBER FACILITY, 
MEMORIZATION) 

Matrix Rotation Task - Constructs: spatial orientation/rotation and short-term memory - A senes of 
five-by-five cell matrices are presented (one at a time in the t:enter of the CRT) with five illuminated ceils per 
rnatrix. The subject is required to compare successive displays and determine if they are the same or 
different from the immediately preceding illuminated matrix. Response requires pressing a key tor 
•'Same" and a "2" key for different". (VISUALIZATION, PERCEPTUAL SPEED, MEMORIZATION) 

Memory Search Task - Constructs: encoding, categorization, response selection and execution 
(visual and auJitory modalities/short-term working memory) - This task requires a subject to maintain m 
memory a "study set" of alphabetic characters. Following the presentation of the study set, individual 
probe letters are presented to the subject for classification as members of the study set or non-members. 
Subjects respond by pressing the appropriate key on a two-button keypad. Six versions fo the task are 
available in the battery: Visual Fixed set. Visual Mixed set, Visual Varied set, Auditory Fixed set. Auditory 
Mixed set, and Auditory Varied set. (PERCEPTUAL SPEED, MEMORIZATION) 

Pattern Comparison (Simultaneous) - Construct, perceptual speed/pattern recognition - The 
subject is presented with two, eight-dot patterns next to each other on the screen. The subject indicates 
whether or not the two patterns are identical by pi'essing the appropriate response buHon 
(PERCEPTUAL SPEED) 

Pattern Comparison (Successive) - Constructs, perceptual speed/short-temn spatial memory A 
random pattern of "dots" is presented on a screen and is followed by a blank retention mtervil. A second 
pattern is then presented and the subject presses a button to indicate whether t.he second pattern is the 
same ordifferent than the first. (PERCEPTUAL SPEED) 

Short-Term Memory • Construct: short-term recall - In this task, the subject is presented with a string of 
consonants on a CRT. This target string presentation is followed by a blank screen for two seconds and 
then a new string of letters is presented. The second string is the test string. The subject is required to 
indicate whether the test string is identical to the target string. The subject responds by pressing one of 
two buttons labeled "same" or "different", respectively. (PERCEPTUAL SPEED, MEMORIZATION) 

Spatial Processing Task Constructs, spatial orientation/rotation and short-term memory - This task 
requires the operator to view a series of histogranis presented one at a time. The operator must determine 
whether the second histogram in each set of two is identical to the first and respond either positively or 
negatively on a two button keypad. Target and comparison histograms are mari^ed with the numbers 1 and 
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Gpatlal Processing Task (cont.) 

2, respectively, so that subjects can keep track. Low task demands are placed on the operator when two 
bar histograms are presented with comparison items in the 0-degree orientation. Four bar stimulus pairs 
with comparison Items at the 90-degree and 270-degree orientation represent a moderate loading 
condition. Finally, six bar comparison histograms presented at the 180-degree orientation impose 
relatively high demand <. the operator. (PERCEPTUAL SPEED, VISUALIZATION) 

Sternberg Tracking Combination (Dual-Task Paradigm) - Construct, time sharing ability - This 
"dual-task" represents a combination of the Memory Search Task (Visual-Fixed set) and the Unstable 
Tracking Task. This combination requires simultaneous executions of responses as described for each 
task. All subjects are required to track with their left hand and respond to the memory search task wiiri tneir 
right haiid. (RESPONSE ORIENTATION, TIME SHARING) 

StroopTest Construct: interference susceptibility to response competition Interference - There are 
three versions of this test, all of which use the words led, izlufi, and green and their respective colors, in 
the Control Condition (Version 1), individual words are displayed on the CRT in matching colors and the 
subject is required to press a corresponding button as quickly as possible. This is intended to be used m 
conjunction with the Interference Condition (Version 2) to provide an estimate of susceptibility to 
response Interference. The Control version used by Itself -^an serve as a choice reaction time test. In tne 
Interference Conditfon, the display color and the words aru sometimes different and sometimes ihe same. 
The Combined Condition (Version 3) "is designed to require only one test to measure response 
interference as compared to traditional testing procedures requiring two te.sts. A word is displayed m a 
particular color and the subject is required to press the appropriate -espcnse button Indicating tne display 
color. The displayed color is either red, blue or green. The test word is either an interference word or a 
control word. The interference words are red, blUfi, and green , and the control words are fluQ. dOQi, and 
imsSi- If the word being presented is an interference word, then the word and the display coior are 
different; otherwise, the word and display color are ranOumly paired. (SELECTIVE ATTENTION 
RESPONSE ORIENTATION) 

Time Wall - Constmct: time estimatfon - This is a non-verbal time estimation task in which a small object 
moving at a constant speed passes behind an opague barrier and the subject must estimate the moment 
when the object will reappear. Movement is vertical rather than horizontai for punxjses of visual field 
symmetry. The barrier contains a hole or notch the same shape and size as the object, and the subjeci 
estimates the moment when the entire noich will be filled. The subject responds by pressing any button 
on the button box. 



Two-Column Addition - Constmct: number facility ■ This is a subject-paced mental anthmetic lost that 
measures the ability to sum simple addition problems with speed and accuracy. Sets of three two-digit 
numbers are presented simultaneously in columnar format in the center of the CRT. The subject ib 
required to sum ?s rapidly as possible and to enter the answer, most significant digit first, via a kyvDad 
(NUMBER FACILITY) » a • 

Unstable Trading Task - Construct: critical/unstable tracking - This is a loading task designed to piaoe 
variable demands upon human information processing resources dedicated to the execution of rapid and 
accurate manuJ responses. Subjects view a fixed target centered on a video screen. A cursor moves 
vertically from the center of the screen, and the operator attempts to keep the cursor centered over the 
target area by rotary movements of a control knob. (RATE CONTROL, FINGER DEXTERITY) 
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visual Probability Monitoring Task - Constructs: spatial scanning/signal detection - Subiects are 
required to monitor one. three or four computer generated displays having the appearance of 

^^.P rn.h"''' ' "h-- ^^^t d'^P'^y °' a row of Six vertical hashmarks STseven h mark offset 

above the others b indicate the center of the dial. A number appears to the left of each So iSv t 

^rlT^ f ' ^^^^"9"'^^ "b^^^'" Under normal (nonJfgL cfndS S ' 

toca ed below ^,e hashmarks moves from one position to another in random fashion to s rSulate Sie 
pointer ^uctuations on an actual dial. At unpredictable intervals, the pointer on a Sy beq In^^^ 

Z"rm"en,t« tT? ^T^'^l'T V""' °' ''''' '''' °' ^hese leases in'the pointer °^ 

movement are the signals to which subjects are instructed to respond. By pressing an approDriate 

T''''' '° '''' (random pointed Lement) s'aT^™E 

SHARING, some performance strategies may utilize PERIPHERAL VISION) 

Visual Scanning - Construct: perceptual speed - This is a visual search and recognition task In this 
ta k. target and distractor objects are letters of the alphabet arranged as R rows (e g Ler^S^ve) o^^^ 
columns (e.g.. five). The subject scans the array in normal reading order (leftTo riqh bu-to bo«om^ ^nd 
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Walter Reed Army Institute for Research Performance Assessment Battery 
(WRAIR-PAB) 



Thornfj. D.R., Genser, S.G., Sing, H.C.. & Hegge. F.W. (1985). The Waiter Re* erformance 
Asse.<;sment Battery. Neurobehavi orai Toxicotogv and Teratology . 7. 415-41R. 



This battery was designed to be a research too! for foiiowing performance changes over time, ireaimenib, 
dosages or leveis. WRAiR PAB has been appiied to studies of sieep deprivation, sustained performance, 
jet lag, heat stress, physical fatiyje, physical conditioning, atropine use, hypoxia and s:ckle cell disorders. 

Tasks chosen for inclusion in the battery are said to (1) represent a reasonable, realizable sample of 
elemental skills generally regarded as underl>;ng many real-world lasks, (2) have the ability to be 
administered briefly and repe' 3dly, (3) be appropriate for computer implementation and (4) huvb a Known 
or expected sensitivity to physiological, psychological or environmental variables. 

Hardware 

The Apple version requires a 48K Apple II, ll-Plus, or lie with a monochrome monitor, one or two floppy disk 
drives and a programmable timer module (Califomia Computer Systenis 7440 A). 

The IBM compatible version requires a 64K Corona portable computer with internal monochrome monitor 
or an IBM PC with monochrome or color monitor and adapter, one or two floppy disks and a Tecmar 
Labmaster or Labtonder timer card. 

A simple hardware modification rust be added to the Apple machine in order to blank and unblank the 
screen instantly in synchrony with the video frame rate (the vertical synchrony pulse). 

Software 

Applesoft Basic under Dos 3.3. or Microsoft GWBASIC under MS-Dos 2.0. This software program is 
available from the Department of Behavioral Biology, WRAIR. Walter Reed Army Medical Center, 
Washington D.C. free of charge to agencies and professionals in the life sciences. 

The battery does not require touch typing skills, but does require the ability to read and pertorm 
mathematical operations above the grade school level. 

Task Descriptions 

Digit Recall - A test of short-term memory capacity. Nine random digits are displayed in a row across me 
center of the screen for one second. After a three second blank retention interval, eight of the nine digits 
L J re-displayed in a different order. The subject then enters the missing digit. (MEMORIZATION, 
PERCEPTUAL SPEED) 

Encoding/Decoding - The subject is given a series of letters to be translate^ .nto numerica; map 
co-ordinates or vice-versa, by means of a moderately complicated double set of code keys that remain the 
same from trial-to-trial but change from successive lest sessions. The task typically runs for three mmuies. 
(DEDUCTIVE REASONING) 
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Four-Choice Serial Reaction Time - The subject is given a box having four light emiling diodes m a 
square array mounted above four push buttons in a similar square array. Single hghls are illuminated 
randomly and the subject is to press the corresponding button as quickly as possible, thereby mitiating the 
next trial. The task traditionally runs for eight minutes. It requires a California Computer System Model 
7720 parallel interface card and some custom hardware. (RESPONSE ORIENTATION) 

Logical Reasoning - An exercise in transformational grammar. The letter pair "AB*' or *'BA'* is presented 
along with a statement that correctly or inorrectly describes the order of the letters withm the pair. The 
subject decides whether the statement is true (same) or false (different) and presses the "S" or 0" Key 
accordingly. (DEDUCTIVE REASONING. WRITTEN COMPREHENSION) 

Mood Activation Scale - Subjects are presented with 65 adjectives and ask^d to indicate on a 
five-point scale the extent to which each adjective reflects their current feelings. The adjectives were 
selected to represent positive or negative affect, and positive or negative activation. This scale was 
developed by merging two previously separate lists. Thayer's Activation- Deactivation Check List (Thayer, 
1967) and Zuckeman's Multiple Affect Adjective Check List (Zuckerman. Lubin. Vogel. & Vaienus, i j64), 
with three consistency-checking items (dizOL, compliant , cooperative) which are deemed to oe orthogonal 
to mood and subjective activation. 

Mood Scale 11 • An abbreviated three-point scale consisting of thi.1y-six adjectives representing six 
factors identified as Anger. Happineas. Fear. Depression, Activity and Fatigue. 

Pattern Recognition I - A spatial memory task. A random pattern of dots (astensks) is displayed lor 1.5 
seconds followed by a 3.5 second blank retention interval and * n by presentation of a second dot 
pattern that may be the same or different as the first. The subject indicates whether they perceive these 
two pattems to be the same (S) or different (D). (PERCEPTUAL SPEED. MEMORIZATION) 

Pattern Recognition II - A more difficult version of Pattern Recognition I. The pattem consists of 
sixteen dots, of which either two or no dots change. (PERCEPTUAL SPEED, MEMORIZATION) 

Serial Add/Subtract - A machine-paced mental arithmetic task requiring sustained atlenlion. Two 
randomly selected digits and either a plus or minus sign are displayed sequentially in the samo screen 
location The subject performs the indicated operation and enters the least significant digit of the result, it 
the result is negative he adds ten to it and then enters the positive sinyle digit remainder (lor example, 
"3 / 9 / - " equals -6, so enter M"). The digits and signs are presented for approxim^ately 250 msec, 
separated by approximately 200 msec, with the next trial beginning immediately after the key entry. 
(NUMBER FACILITY. MEMORIZATION) 

Six-Letter Search - Same as for the Two-Letter Search, but with six target letters instead of two. Letter 
search tasks are usually run for at least two minutes each. (PERCEPTUAL SPEED, FLEXIBILITY OF 
CLOSURE) 

Time Estimation I • An object which is moving at a constant velocity passes behind a barrier and the 
subject must estimate the moment when it will re-appear. The barrier is a while rectangle liiimg ihe bottom 
third of the display area and which has a black notch centered along its bottom edge. The rTX)ving object is 
a white square of the same size as the notch and which appears at the top center of the display. This 
object descends at a rate such that it would coincide with the notch exactly ten seconds later. The square 
appears to pass behind (or into) the barrier, after which the timer continues to run but nothing else occurs 
until the subject presses a key to indicate his/her estimate of when the square will fill the notch. Neutral 
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Time Estimation I (cont.) 

feedback that a response has been registered Is provided by changing the notch to white for 500 msec 
after the response. 

Two-Column Addition - A subject-paced mental arithmetic task. Five two-digit numbtio are presented 
simultaneously in column for.T2{ in the center the screen. The subject detemimes their sum as rapidly 
as possible and enters it via the keyboa.-d, beginning with the hundreds digit. The task is typically run toi 
three minutes. (NUMBER FACILITY) 

Two-Letter Search • A visual recognition task. Two target letters are presented at the top of the 
screen, along with a string of twenty letters in the middle of the screen. The suhiect presses the "S" hey it 
both of the target letters are present in the longer string, and the "D" key if one m more letters are missmg 
(PERCEPTUAL SPEED, FLEXIBILITY OF CLOSURE) 

Visual Scanning - A search task involving minimal memory loading and separating scanning i,mes from 
preparatory and response execution times. An asterisk serving as a fixation point and one-second warning 
signal Is displayed three character positions to the right of top center. It is replaced with a five-column by 
twenty four-row array of random distractor letters containing one occurrence of the target letter "K". The 
subject scans down the array, presses the "5" key immediately upon detecting the target, and then has 
three seconds to Identify the target's row. Correctness of identification is detemiined m one of two ways. 
(1) pressing the key causes a column of numbers from 01 to 24 to appear one space to the right of the 
array and the subject enters the row number from the keyboard, or (2) tht oubject touches the target letter 
with a light pen. Average scanning rate Is detemnined from the slope of the line re.'dtmg correct response 
times to target row locations. (FLEXIBILITY OF CLOSURE) 
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II D. Human Performance Models / Theories 



Note: To assure the accurate representation of each model, these descriptions are, to a great 
extent, presented in the words of the original author(s). 
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Braune. R. & Foshay. W R.. (1983). Towards a practical model of cognitive/information processing task 
analysis and schemd acquisition for complex problem solving situations. Instmctmnai finmnrft , 
1 21 "145. * 



Introduction 

This model proposes an alternative approach to task analysis of complex environments based on human 
information processing theory. Conventional task analysis fails to promote transference of learning to 
other tasks when applied to task dcmains that are too dynamic, complex and lacking in definition of 
conditions or criteria. Consequently, this model incorporates the theoretical constructs of information 
processing in developing an appropriate task analysis. 

Model Description 

The rriodel relies upon three key factors on which the method of task analysis is based, namely 1) a 
descnptive model of human performance 2) an understanding of the roles of expectancies in 
problem-solving, and 3) an understanding of the relationship between expectancies and schemata The 
three factor? combine to suggest a model of schema acquisition and problem-solving in complex 
environments which is suitable for informatio" processing task analysis. 

A Descriptive Model of Human Performance 

The model rep'esents four dimensions which influence an individual's performance 1) knowledge 
2) cognitive/information processing. 3) physiological state anJ. 4)motivatlonal/emotional state. Individuals 
can differ in their capacity along any one of these four dimensions and also within each one of the four by 
level of competency. It is assumed that individuals can compensate in one dimension if performar.ce 
capacity in another dimension is not at the requisite level :or a given \!^sk. 

Probler- Solving and Expectancies 

A pri.ncipal component of human problem-solving is the expectancj or goal determination which controls 
he strategy used for chunking. T^e way in which stimuli are chunked is a major determinant of success on 
the p.'oblem-solving task. 

Expectancies and Schemata 

Schema acquisition is a concomitant of perception. This close linkage of schemata and expectancies 
suggests tha. the process of problem-solving leads to acquisition of schemata just as doej perception. 

Schema Theory and Task Analysis 

The model introduces the concept of a schema in the context of instructional design. A three-part strateqv 
fori: ormaticn processing task analysis or instructional design is suggested. 1) conducting a concept 
hierarchy analysis of the task domain by selective positioning of operators based on background 
know-eago. 2) planning positive and negative example sets to enhance the learner's understanding of 
individual concepts, and 3) developing a progression of problems which help the leamer assimilate f d 
knowlsuge into existing schema i)y combining concepts. 
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An Example of Problem-Solving Task Analysis 

The model examines the tasks of judgment and decision-making on both a micro-level and macro-level 
The micro-level assesses the concrete perceptual-motor domain. Examples are precision of specitic 
maneuvers or correctness of following a specific procedure. Methods used to gauge this type of 
performarce include observations by check pilots, sisnulator recording and inflight monitoring systems 
The macro-level of judgment examines the abstract tasks of mission planning, execution and situational 
assessment. 

A Model for Schema Utilization and Modification 

It is probably true that at the micro-level no generalizable problem-solving process seems to exist The 
evidence suggests that at the macro-level a general schema utilization and modification process can be 
found. 

The model represents an attempt to provide a framework upon which instructor-student interaction can be 
buHt and which has as its goal the utilization and modification of existing schemata and the creation of new 
schemata The model attempts to account for three different kinds of learning proposed by Rumelhart and 
Norman (1981^ namely, 1) accretion, 2) schema evolution . and 3) schema creation. It is also consistent 
with an approach proposed by Evans (1982) called "problem-orier.ted instruction". The primary objective 
of the pr^Kiosed process is to make overt the learner's problem-solving procedures and to model a 
process control schema (Kozminsky, Kintsch, & Bourne, 1981) which allows the leamer to deal with newly 
encountered stimulus events. 



Discussion 

This work attempts to take the findings from information processing research and translate them into a 
practical approach that can be applied by instructional developers and instructors m complex task domains 
one of the problems that can be seen is that explicit procedures must be developed for mapping the 
simple-to-complex progression of problems. Ultimately, the model also must take into account J four 
dimensions affecting human performance. 



Associated Abilities 

An assessment for the tasks associated with this model identified the following abilities: 

1. Category Flexibility 

2. Deductive Reasoning 

3. Inductive Reasoning 

4. Perceptual Speed 

5. Problem Sensitivity 

6. Selective Attention 

7. Speed of Closure 
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Chu.Y & Rouse. W B (1979). Adaptive allocation of decisionmaking responsibility between human and 
computer in multita?'- situations. IEEE Transactions on Svstfims M an and CvhPmPt| r;^ SM£:2(12). 



Introduction 



The nnodel described is based on 3 jueueing fonnulation in which muliitasl^ decisionmaking and a 
tnreshold policy for turning the co.nputer on/off is proposed. This policy minimizes event-waiting cost 
subject to ULman workload constraints. Data was collected to estimate the parameters of a queueing 
model of pilot decisionmaking in unided monitoring and control situations. The model qives reasonable 
predictions of pilot performance in performing subsystem tasks. 



Model Description 

Rouse (1977) has suggested that a dynamic or adaptive allocation of responsibilities may be the best 
mode of human-computer interaction. With adaptive allocation, responsibility at any particular instant will 
go to the decsionmaker most able at the moment to perform the task. The adaptive policy proposed here 
allocates decisionmaking responsibility so as to optimize system performance by maintaining human 
workload at appropriate levels. !t is proposed that allocation decisions be automated and delegated to a 
computerized coordinator. 

Proposed Algorithm 

Rouse (1977) has described human-computer interaction in multitask decisionmaking situations as a 
queueing system with two servers (human and computer) and K classes of customers. Given this 
description, the problem of allocating decisionmaking responsibility is simplified to one of detemiining who 
serves a particular customer, or .o which server should the arriving customer be directed. 

Heyman (1968) proposes an optimal threshold policy which has a simple critical number characterization 
S s). This (S s policy IS to provide no service if the system size, N '-umber of customers in the queue), is 
(s) or less, and to tum the server on when the size N is greater than (S). The cost incurred include'-, waiting 
cost, running cost, and switching cost. 

The optimal threshold policy (i.e., S and s) should vary as the .system variables vary. Sources of variation 
include: (1) traffic demand (arrival rates). (2) server performance and task complexity (task involvemen 
service rates, and probabilities of error), and (3) system and performance uncertainties (unidentified ' 
parameters). 

A simulation approach was adopted to determine the optimal stationary policy because analytical 
procedures for determining the optimal thresholds were judged to be cumbersome. 

There are three classes of input variables in the simulation procedure. The first class includes process 
arrival rates, service rates, and waiting cost rates for subsystem processes. The second class of vanables 
are those specific to the decisionmakers: the probabilities of incorrect actions and missed events the 
false alarm arrival rates and service rates, ocan times, task sv. 'ching times, and computer on/oft switching 
times. The third class of variables includes the control limits, S and s. The simulation output supplies 
statistics for the operational characteristics of interest i,uch as waiting time and severe occupancy 
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A Queueing Theory Formulation 

Aqueueing formulation of multitask decisionmaking with two servers (the pilot and the computer) ar.d 
(K-hl) classes of customers (K subsystem events plus control events represented by displayed guidance 
errors In the manual control mode) was developed. This queueing representation of the flight 
management ask not only provides the features of a time-line analysis of continuous control and 
performance of discrete-time events, but also provides a basis for. 1) mathematical analysis of control of 
event arrivals and servicings, 2) flexible representation of time-varying priorities, and 3) ready extension to 
multiple operator systems. 



Discussion 

This approach is said to be applicable to multitask situations where system critera and goals are clear, 
computer decision aids are desirable, the tasks to be performed are well structured, and the tim^ de;ay cf 
discrete events is of major concern. Situations falling into this category include flight management, air 
traffic control, various industrial process monitoring, and control tasks. 



Associated Abilities 

An assessment of the tasks associated with this rriodel identified the following abilities. 

1. Deductive Reasoning 

2. Inductive Reasoning 

3. Information Ordering 

4. Problem Sensitivity 

5. Reaction Time 

6. Response Orientation 

7. Selective Attention 
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Levison, W.H. (1982). The optimal control model for the human operator. Theory, validation, and 
application Proceedings of the Work shop on Flight Testing to identify P>!ot \NorU\n^d ^r^d Pilot Dyna^'cs 
(551-579). Edwards AFB. CA. 



Introduction 

The Optimal Control f^odel (OCM) is an informational model of the task environment which is based on the 
assumption that the well-motivated, well trained human operator will act in a near optimal manner suDject lo 
the operator's internal limitations and understanding of the task. The OCM differs from other models of ihe 
human operator in the following ways. 1) the methrds used to represent human limitations, 2} the 
inclusion of elements that compensate optimally fo *hese limitations, and 3) the extensive use of 
state-space concepts and the techniques of modern control theory. 



Model Description 

Application of the OCM requires specification of the following features of the environment. 1y a Imeanzed 
state variable representation or model of the system beirg controlled, 2) a stochastic or determmisuc 
representation of the driving function or environmental disturbdnces over whicf i the operator must exert 
control, 3) a linearized "display vector" summarizing the sensory information utilized by the operator 
(including visual, vestibular and other sources as appropriate), and 4) a quantitative statement of the 
criterion or peiformance index for assessing operator/machine performance. (Klemman, Baron and 
Levison, 1970). 

The OCM is a model for the dynamic response behavior of the closed-loop control system. Because the 
model is capable of treating multl variable systems, all system varicibles are represented as vector 
quantities. The portici of the model structure designated as "Human Operator Moder contains elements 
rslaled to the operator's adaptive response behavior and to limitations that constrain this behavior. These 
model elements are reviewed below in the order corresponding to the flow of information. 

The variables are assumed to be coraipted by "observation noise" introduced by the human operator. 
This noise is analogous to the intemal noise level postulated in signal detection theory and provides one 
means by which the model accounts for humn limitations in perceptual resolution, centrai-procebsmg, 
and attention-sharing capacity. At this point, the model is dealing with a noisy representation of the 
displayed quantities. This representation is then delayed by an amount representing internal human 
processing delays. 

The central elements of the model are referred to as the Kalman estimator and predictor. Their 
purpose is to generate the best estimate of the current state of system variables, based on the noisy, 
delayed perceptual information available. These elements compute the estimate of this state so as to 
minimize the residual estimation uncertainty, they represent the operator's ability to constmct from his 
understanding of It * system and his incomplete knowledge of the moment-by-moment state of the 
system, a set of expectancies conceming the system behavior at the next moment in time. These 
elements refleol the assumption that the human operator has both an intemal model of the dynamics of 
the system being 'controlled, and a representation of the statistics of the disturbance driving the system. 

Given the best estimate of the curreni system slate, the next model element ("L*") assigns a set of control 
gains or weighting factors to the elements of the estimated state, in order to produce control actions that 
will minimize the defined performance criterion. 
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Just as an observation r.oise is postulated to account for perceptual and central processing inadequacies, 
a motor noise is introduced in the model to account for an inability to generate noise free control actions. 
In many applications this noise level is insignificant in comparison to the observation noise, but where very 
precise control is important to the conditions being analyzed, nx)tor noise can assume greater signilicance 
in the model. Finally, the noisy control response is assumed to be snx)othed by a filter that accounts for an 
operator bandwidth constraint. In the nx)del, this constraint arises directly as a result of a penalty on 
excessive control rates included in the performance criterion. The constraint may mimic actual 
physiological constraints of the neuronx)tor system or it may reflect subjective limitations imposed Dy me 
operator. 

It should be emphasized that the parameter values that must be provided by the investigator correspond 
to the human limitations that constrain behavior. WAh these limitations as the constraints within whicn 
perfomnance is proouced, the model predicts the best that the operator can do. 

Note. Although the current presentation includes only a conceptual description, the ongmal paper 
contains extensive explanation of the mathematical components involved in the model. 

Discussion 

The OCM has been applied-mostly with regard to aircraft flight-as a predicave and as a diagnostic tooi. 
Areas of application include display design and evaluation, control design and evaluation, prediction of 
aircraft handling qualities, simulator design and evaluation, effects of environmental stress, and design ot 
experiments. 



Associated Abilities 

An asses'^ment of the tasks associated with this model identified the following abilities, 

1. Control Precision 

2. Glare Sensitivity 

3. Near Vision 

4. Night Vision 

5. Time Sharing 
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Muralidharan, R., Baron, S., & Feehrer, C. (1979). A decision, monitoring, and control model of the human 
operator applied to an RPV control problem (Tech Rep. AFOSRTR'79'0675). Washington, DC. US Air 
Force Office of Scientific Research. 



Introduction 

This paper describes application of a decision-making, monitoring and control model (DEMON) of a human 
operator ontrolling Remotely Piloted Vehicles (RPVs). The DEMO^J model is an extensio.i of the Optimal 
Control Model (OCM) of the operator and was derived by infusing decision theoretic notions into the basic 
OCM structure. The resulting model is designed to treat situations in which control actions may be 
infrequent while monitoring and decision-making are the operator's main tasks. The task modelled is a 
simplified version of an RPV mission. 



Model Description 

The DEMON model is an example of a top-do.wn or analytic approach to human performance modelling. 
This approach begins with a mathematical characterization of the task, including the overall goals and the 
criteria for good performance. Assumptions are then deveL,, i regarding the human operator and the 
system in order to characterize performance in relation to the parameters of interest to system designers. 

Theoretical Foundation 

DEMON has its roots in control theory, statistical estimation, and decision theory. It draws heavily on the 
information procesoing model implicit in the OCM model of the human operator (Baron. 1976). To this 
information processing structure is added a decisi'on-mdking structure for modelling discrete monitoring 
and control decisions and a structure for computing continuous control actions. 

Expected Net Gain 

The deciston- making structure in DEMON incorporates an expected net gam (ENG) concept, which is 
used as a criterion for making a rational choice among altematives. The ENG of a particular action is 
calculated by subtracting the cost of that action from its expected gain. The expected gain itself is the 
difference between the expected cost of events when no action is taken and the expected cost of events 
that may arise after this action. The rational choice is to select that action which has the greatest ENG. 

Closed-Loop Control System 

The DEMON modelling approach views the human operator, during the enroute phase on an RPV 
mission, as an element in a cbsed loop control system. Further elucidation as well as mathematical details 
for each element of the model are presented by Muralidharan. et al. 



Discussion 

Experimental use of the DEMON model has yielded results typical of those obtained with a top-down 
approach to modelling the RPV control model. Results reported for monitoring performance are said to 
indicate that the model does behave reasonably, that ihe parameters significantly affect the performance 
and that the monitoring and patching trends are as expected. 

These parameters appear to adequately capture the impo;t .nt aspects of vanations m monitoring and 
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patching strategies. The parameters further demonstrate how ths model may address important 
considerations relevant to the system designer, including RPV/Operator ratio, allowable navigation errors 
and tolerable reporting errors. 



Associated Abilities 

An assessment of the tasks associated with this model identified the following abilities. 

1. Control Precision 

2. Deductive Reasoning 

3. Inductive Reasoning 

4. Information Ordering 

5. Problem Sensitivity 

6. Reaction Time 

7. Response Orientation 
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Sanders. A.F. (1983). Towards a model of stress and human performance. Acta Psychologica, 52, 61-97. 



Introduction 

The model attempts to relate energetical and tuctural mechanisms of human information processing and 
to incorporate an interactionally defined concept of stress in human performance research. The model is 
based upon a linear stage notion of information processing. This approach describes information flow 
through the organism as a sequence of processing stages mediating the transfomriation from signals into 
responses. In accord with Pribram and McGuiness (1975), three energetical supply systems are proposed 
which are selectively related to specific cognitive processing mechanisms. 



Model rescription 

The model assumes the duration of processing in each stage is affected by the state of the subject as well 
as by computational demands. Sanders (1981) has briefly described an outline of the model. It rehet. 
upon four computational stages in Ihe traditional choice reaction process. These stages are. 1) 
stimuluS'preprocessing (affected by signal intensity), 2) feature extraction (affected by signal quality). 3) 
response choice (affected by S-R compatibility), and 4) motor adjustment (affected by time uncertainty). 

A relevant assumption of the model is that effects of oubject's state on procesSi..jj duration are limited by 
the extent to which active processes play a role in the cognitive operations of a stage. 

Three Types of Ff nergetical Supply 

:n line with the notion of multiple resources, the processes involved in different stages draw upon different 
energetical resources. A first resource type is related to motor adjustment, a second to feature extraction 
and a third to response choice. Stimulus preprocessing is only dependent upon automatic p.ocesses and 
thus does not require a separate energetical resource. 

Pribranri and McGuinness (1975) consider three systems in the control of attention, namely. (1) an arousal 
system as a phasic response to input. (2) an activation system as a ton.^ readiness to respond, and finally 
(3) an effort mechanism as a coordinating and organizing principle. Effort is supposed to coordinate the 
activity of arous';l and activatiori. but has in addition the wider function of promoting the competence ot the 
information processing system. 

A Model of Stress and Arousal 

Coupling neurophysiclogical notions to thoso derived from the linear stage model delivers the mam 
elements of this cognitive-energetical linear stage model of humd.. information processing and stress. 
The cognitive level consists of computational processing stages. The basal mechanisms are coordinated 
and supervised by effort, which is also directly linked to the central stage of response choice. Apart from 
direct energeucal supply to this stage, effort serves the function of keeping the basal mechanisms at an 
optimal value. Information about the state of the basal mechanisms is mediated by an evaluation 
mechanism. 

A Cognitive Concept of Stress in Human Performance Theory 

Stress will arise whenever the effort mechanism is either seriously overloaded or falls short m 
accomplishing the necessary energetical adjuslments. According to this formulation, stress and effort 
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covary to Ihe extent that continuing high demands on effort withoui sufficient success in maintaining or 
restoring an equilibrium are supposed to constitute the basis of stress responses. Thus, allocating c;;oft 
does not evoke stress per se. It is the presence or the threat of d lasting disturbance of the equllibnum 
which is essential. Stress may arise because effort fails in correcting the effects of too high or too low a 
level of arousal, too hijh oi too low a level of activation, or finally, there may be failures in the supply of 
sufficient energetical resources to reasoning and decisionmaking processes. This implies at least fue 
patterns of stress. The converging element of these patterns is a deviant state of the evaluation s>stem, 
which may cause a common subjective feeling of stress. 



Discussion 

In agreement with several recent suggestions (e.g., O'Hanlon 1981) this model shares the deduction mat 
subjects who show high leveis of perfomnance under suboptimal conditions are most under stress. They 
appear to continually allocate effort to arousal and'or activation, thereby counteracting a decremer.l or a 
low performance asymptote. 

It is concluded that performance measures are not effective indicants of stress. They are only needed as a 
control measure to ensure that sufficient effort is allocated to keep performance at the optimum. The 
stress response must be measured in pnysiological and/or hormonal patterns as reflections of the 
overdemands on effort. Problems of undorarousal. underactivation and their combined occurrence are 
most easily investigated by way of such techniques. 



Associated Abilities 

An assessment of the tasks associated with this model identified the following abilities. 

1. Control Precision 

2. Flexibility of Closure 

3. Perceptual Speed 

4. Reaction Time 

5. Response Orientation 

6. Selective Attention 

7. Speed of Limb Movement 
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Wherry, Jr., R. J. & Curran, P. M. (1966). A model for the study of some determiners of psychological 
stress. Initial experimental research. Organizstional Behavior and Human Performance .l. 226^251. 



Introduction 

During critical periods of a mission, suscepjbility to anticipatory physical threat may be the decisive factor 
between success or failure of the . ission, and the life or death of the pilot. The authors postulate that the 
real issue in threat research is the manner in which the individi-al perceives the environment. 



Model Description 

According to the anticipatory physical threat stress (ARTS) model, there are three major determiners of 
amount of stress generated. It is said that most, if not all, of the variance of what is generally understood by 
the concept of "threatening" can be subsumed under these three elements: 

(1) The perceived probability that the event (E) will occur (P*). The important point here is that ARTS is a 
function of the perceived probability that the unpleasant event will occur (P*) as opposed to the tme 
probability of its occurrt^nce (P). P* is a composite of at least three evaluations which the individual may 
make. The first of these is the perceived probability that the event will occur attributable to self 
performance (P g), which Is a'multiplicative function of the individual's perceived quality of performance 
(Q's) and the perceived relevance of such performance to occurrence of the event (R g). A second 
contributor to P' is the perceived probability of event occurrence attributable to other members of the 
leam" (Pq). in cases where several subjects' performances detemnine the success or failure of a mission. 
Pq is hypothesized to be a multiplicative function of the individuals perception of the relevance of their 
performance to event occurrence (R q). The final contributor to P' is the perceived probability of event 
occurrence attributable to uncontrollable or chance factors (P y). 

The foregoing statements have been summarized in equation form as follows; 

APTS=:f^(P') 

P = f2(Ps + P'o + P'u)» 
P = f3(QsX Rs), 
Po^UlQ'o xR'o).and 
APTS = f 1 (f2(f3(Q s X R s) + f4(Q 0 X R'o) + P u). 

(2) The perceived proximity of the event (X') includes temporal, spatial, and psychological proximity. The 
latter two are undoubtcfdiy confounded with temporal proximity in most cases, however, APTS considers 
only temporal aspects of the event. Proximity, in its broadest interpretation, indicates tne perceived 
"closeness" of the event. 

Some of the temporal aspects of proximity are the perceived time until the event will occur (if it does occur) 
(r^), the time elapsed since the subject was given a warning that the event . light occur (Ty^) and the 
perceived time since the mission (or situation) began [T^). As the unpleasant event gets "closer" to the 
subject (i.e., gets smaller) it is hypothesized that the anticipatory stress generated will increase, i.e., 

APTS = f6(1/T'E)- 
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(3) The perceived unpleasantness of the event if it occurs (U') is hypothesized to be a function of at least 
three evaluations which the subject will make. These are the perceived duration of incapacitation it the 
event occurs (D\),lhe perceived duration of pain if the event occurs (Dp;, and the perceived unpleasant 
effect the event will have on others whose welfare is important to the subject (U o). It is hypothesized that 
these three evaluations summate to yield.the overall unpleasantness ot the event. Thus. 

APTS = f7(U'), 

U* = f8(D'i + D'p + U'o). 

All three of the preceding evaluations are hypothesized to be a function of the perceived mtenciy of the 
event (r), the perceived duration of tl.o event (D e). and the perceived area of the subject that wn. be hurt it 
the event uccurs (A'). Thus, 

(D'i-D'p+U'o) = f9(l\D*E,A') 

The composite APTS model is hypothesized to take the fomri: 
APTS = f(PxX'xU'). 

In addition, derivations of this mode! are set forth to account for . (1) situations in which there are no other 
^leam" members, (2) situations where the subject perceives his performance is not relevant to event 
occurrence, and (3) whether all subjects were tested under identical event duration (D ) and area of self to 
be hurt (A'). 



Discussion 

The model points out the importance of the role of perception in threat studies. The model predicts that 
one's perceptiv/n of proximity of the unpleasant event will determine the amount of threat present. 

Experimental use of the twde\ has yielded several findir ^s. (1) confirmation of the hypothesis that miid 
stress can be enhancing to performance, while larger anr*wunts of stress can cause decrement, (2) a 
significant effect of past experience- it appears thai confirmation of one's expectations about event 
occurrence will reduce performance deterioration in subsequent situations, (3) even when the amount of 
threat is carefully equated for all subjects, some wiirbo more susceptible to stress effects than will others. 



Associated Abilities 

An assessment of tlie tasks associated with this model identified the following abilities. 

1. Deductive Reasoning 

2. Inductive Reasoning 

3. Problerr* Sensitivity 

4. React on Time 

5. Response Orientation 
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Wickens. C D (1980a) The multiple rfifioiirofts mnrig l of human pfirtormancft Implications for riisplay 
design (Contract N-000-14-79-C-0658). Arlington, VA: Office of Naval Research. 

see also: 

Wickens. C D (1984) EnoineerinQ psychology and human nBrformancA Columbus, Ohio. Merriii. 

Introduction 

The multiple-resource model asserts thai Instead of one central "pool" of resources with satellite 
structures, humans possess several different capacities with resource properties. Tasks will interfere 
more if more resources are shared. This position has received explicit theoretical development withm the 
framework of the performance operating characteristic (POC) by Navon and Gopher (1979). Wickens 
(■•9P0) has argued that resources may be defined by three relatively simple dichotomous dimensions. 
There are two stage-defined resources (early versus late processes), and two modality-defmed resources 
(auditory versus visual oncoding), and two resources defined by processing codes (spatial versus verbal). 



Model Description 

To the extent the", 'ny two tasks demand separate rather than common resources on any of the three 
diniensions, three phenomena will occur: (1) time-sharing will be more efficient, (2) changes m the 
difficulty of one task will be less likely to influence performance of the other, and (3) the POC constructed 
between the tasks wili be of a "boxlike" form because resources withdrawn from one task cannot be used 
to advantage by the other, since they are dependent upon different resources. 

Stages 

The resources used for perceptual and central-processing activities appear to be the same, and these are 
functionally separate from those underiying the selection and execution of responses. Evidence for this 
dichotomy is provided when the difficulty of responding in a task is varied and this manipulation does not 
affect performance of a concurrent task whose demands are more perceptual in nature. 

Modalities 

Humans can sometimes divide attention between the eye and ear better than between two auditory 
channels or two visual channels. That is, bimodal time-sharing is better than mtra-modal. Poor time-sharing 
With intra-modal displays can, therefore, be expected if the two visual sources are .,yatially separated so 
that both cannot access foveal vision simultaneously or if the two auditory sources mask each other. 

Processing Codes 

Spatial and verbal processes, whether functioning in perception, worthing memory or response stages, are 
said to depend u|.on separate resources. The separation of spatial and verbal resources seemingly 
accounts for the high degree of efficiency with which manual and vocal outputs can be time-shared, 
assuming that manual r(,sponses are usually spatial in nature and vocal ones are verbal. 
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Discussion 



The three dimensions of the multiple-resource moUel are not intended to account for all structural 
influences on dual^task performance and time^sharing efficiency. They indicate three major dichotomies 
that can account for a large portion of these influences and can be used by the system designer. 

^ ^ere are many ways in which two tasks can be similar that intiue.ice the efficiency of their time-sharing but 
a J not accounted for by the three dimensions. These include several factors. (1 ) two tasks may have 
different iming requirenfients-tasks with different rhythmic requirements are hard to time-share. (2) 
manual cK)ntrol tasks with different control dynamics reduce time-sharing efficiency, and (3) two tasKs may 
have similar processing elements-two tasks that use both digits and letters will be more easily time-snared 
than two tasks using the same material. Two tracking tasks that use horizontal and vertical axes, 
respectively, will be better time-shared than two tasks using the common direction. 



Associated Abilities 

An assessment of the tasks associated with this model identified the following abilities. 

Auditory Attention 

2. Control Precision 

3. Memorization 

4. Rate Control 

5. Reaction Time 

6. Response Orientation 

7. Selective Attention 

8. Spatial Orientation 

9. Time Sharing 
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II E. Task Source References 



Task 

Absolute Difference Calculation (IPPB) 

Activities Interest Inventory (PORTA-BAT) 

Alpha-Numeric Visual Vi^^ilance (UTC-PAB) 

Arithmetic Computations (MTPB) 

Arithmetic Speed (TASKMASTER) 

Auditory Digit Span (NAVAL CCT) 

(Visual and) Auditory Grammatical Reasoning 
(NAVAL CCT) 

(Visual or) Auditory Serial Addition 
(NAVAL CCT) 

Auditory-Spatial Sternberg (IPPB) 

Auditory-Verbal Sternberg (IPPB) 

Automatic Aircrew Personality Profiler 
(PORTA-BAT) 

Blinking Lights Monitoring (MTPB) 
Choice Reaction Time (NAVAL CCT) 
Code Lock Solving (MTPB) 
Code Substitution (APTS) 
Code Substitution (NAVAL CCT) 
Coio Substitution (UTC-PAB) 
Continuous Performance (NES) 
Continuous Recall (CTS) 
Continuous Recall (UTC-PAB) 
Critical Instability Tracking (IPPB) 



Cited Sourcefs^ 



Herd, 1982 



Sternberg, 1969 
Sternberg, 1969 



Wechsler, 1958 

Rosvold, Mirsky, & Sarason, 1956 
Hunter, 1975 
Hunter, 197£ 

Jex, McDonnel, & Phatak. 1966 
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LlSlL 

Decision Making Speed (PORTA-BAT) 

Dichotic Listening (IPPB) 

Dichotic Listening (UTC-PAB) 

Digit Recall (WRAIR-PAB) 

Digit Span ^NES) 

Dot Estimation (PORTA-BAT) 

Embedded Figures (IPPB) 

Embedded Figures (PORTA-BAT) 

Encoding/Decoding (WRAIR-PAB) 

Encoding Speed (PORTA-BAT) 

Four-Choice Serial Reaction Time (UTC-PAB) 

Four Choice Serial Reaction Time 
(WRAIR-PAB) 

Free Recall of Word List (TASKMASTER) 

Grammatical Reasoning (APTS) 

Grammatical Reasoning (CTS) 

Grammatical Reasoning (TASKMASTER) 

Grammatical Reasoning-Traditional (UTC-PAB) 

Grammatical Reascninc Symbolic (UTC-PAB) 

Grammatical Reasoning with Reaction Time 
(TASKMASTER) 

Hand-Eye Coordination (NES) 

find Steadiness (TASKMASTER) 

Immediate/Delayed Memory (PORTA-BAT) 

Interval Production (CTS) 



Cited SniirnPff;) 
Gopher, 1982 

Gri.'fen & Mosko, 1985, 1982 
Wechsler, 1955, 1945 



Haslam, 1981 



Wilkinson & Houghton, 1975 



Wilkinsons Houghton, 1975 



Baddeley, 1968 



Baddeley, 1968 



Michan, 1966 
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Interval Production (UTC-PAB) 
Item Recognition (PORTA-BAT) 
Linguistic Processing (CTS) 
Linguistic Processing (UTC-PAB) 

Linguistic Processing-Ctioice Reaction Time 
(UTC-PAB ) 

Logic Task (NAVAL CCT) 
Logical Reasoning (WRAIR-PAB) 
Manikin (APTS) 
Manikin (NAVAL CCT) 
Manikin (UTC-PAB) 
Math Test (NAVAL CCT) 
Mattiematical Processing (CTS) 
Mathematical Processing (UTC-PAB) 
Matrix Rotation (UTC-PAB ) 
Maze Task (NAVAL CCT) 
Maze Tracing (IPPB) 
Memory Scanning (NES) 
Memory Search (CTS) 
Memory Search (UTC-PAB) 
Mental Rotation (PORTA-BAT) 
Mood-Activation (WRAIR-PAB) 

Mood Scale II (WRAIR-PAB) 
Mood Scales (NES) 



Cited Soiirrpfs^ 



Posner & Mitchell, 1967 

Posner & Mitchell, 1967; Shulman, 
1974; Craik & Trilving, 1975 



as at)ove for each individual task 



Baddeley, 1968 



Reader, Benel, & Rahe, 1981 



Shingledecker, 1984 



Sternberg, 1969 
Sternberg, i969 
Sternberg, 1969 

Thayer, 1967; Zuckerman, Lubin, 
Vogel, & Valerius, 1964 

Ryman, Biersner, & Rocco, 1974 

McNair, Lorr, & Droppleman, 1971 
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laslL 

Moving Landolt C (APIS) 

Noise Fusion (TASK^lASTER) 

Non-Preferred Hand Tapping (APIS) 

Paired Associate Learning (NES) 

Pattern Comparison (NAVAL CCT) 

Pattern Comparison-Simultaneous (UTC-PAB) 

Pattern Comparison-Successive (UTC-PAB ) 

Pattern Memory (NES) 
Pattern Recognition (APIS) 
Pattern Recognition (NES) 
Pattern Recognition ! (WRAIR-PAB) 
Pattem Recognition II (WRAIR-PAB) 
Perceptual Speed (PORTA-BAT) 

Preferred Hand Tapping (APTS) 

Probability Monitoring (CTS) 

Probability Monitoring (MTPB) 

Psychomot( Device Tests (PORTA-BAT) 

Questionnaire Tests (TASKMASTER) 

Reaction Time (APTS) 

Reaction Time (TASKMASTER) 

Response Alternation (TASKMASTER) 

Risk Taking (PORTA-BAT) 

Second Order Tracking (IPPB) 

Self-Crediting Word Knowledge (PORTA-BAT) 



Cited Sour(;:<^f< ?) 



Wechsler, 1945 



Klein &Armitage, 1979 

Thorne, Genser, Sing, & Hegge, 
1985 

Acker, 1982 



Chiles, Alluisi, & Adams, 1968 
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Task 

Serial Add/Subtract (WRAIR-PAB) 
Short-Term Memory (UTC-PAB ) 
Simple Reaction Time (NES) 
Six-Letter Search (WRAIR-PAB) 

Spatial Processing (CTS) 
Spatial Processing (UTC-PAB) 
Spoke Task (NAVAL CCT) 
Sternberg (ARTS) 

Sternberg Memory Scanning (NAVAL CCT) 
Sternberg-Tracking (UTC-PAB ) 
Stroop (UTC-PAB) 

Sttoop-Like Color Naming (NAVAL CCT) 
Symbol-Digit Substitution (NES) 
Target Identification (MTPB) 
Timo Estimation (TASKMASTER) 
Time Estimation (WRAIR-PAB) 
Time Sharing (PORTA-BAT) 
Time Wall (UTC-PAB ) 

Two-Column Addition (WRAIR-PAB) 

Two-Hand Tapping (APTS) 
Two-Letter Search (WRAIR-PAB) 

Unstable Tracking (CTS) 



Cited Sourcefs) 
Wever, 1981, 1979 

Folkard, Knauth, Monk, & Rutenfranz. 
1976 

Chiles, Alluisi, & Adams, 1968 
Chiles, Alluisi, & Adams, 1968 



Wickens & Sandry, 1982 

Stroop, 1938; Flowers & Stoup, 1977 

Wechsler, 1955 

Seppala & Visakorpi, 1983 

Jerison & Arginteau, 19'^8; Seppala & 
Visakorpi, 1983 

Ekstrom, French, Harman, & Derment, 
1976 

Folkard, Knauth, Monk, & Rutenfranz, 
197e 

Jex, McDonnel, & Phaiak, 1966 



76 «6 



NTSC TR86-020 



Unstable Tracking (UTC-PAB) 

Visual (and Auditory) Grammatical fteasoi.ing 
(NAVAL CCT) 

Visual Probability Monitoring (UTC-PAB ) 

Visual Retention (NES) 

Visual Scanning (UTC-PAB) 

Visual Scanning (WRAIR-PAB) 

Visual or Auditory Serial Addition 
(NAVAL CCT) 

Visual-Spatial Sternberg 

Visual-Verbal Stemberg (IPPB) 

Vocabulary (NES) 

Warning Light? Monitoring (MTPB) 

Zip Code Typing (TASKMASTER) 



Cited Sourcefs) 



Chiles, AlluisI, & Adams, 19b8 
Lezak, 1976 
Neisser, 1963 



Sternberg, 1969 
Sternberg, 1P69 
Jensen, 1980 
Chinn & Alluisi, 19lU 



77 



87 



"NTSO TR86-020 



III. Summary and Conclusions 

This project has demonstrated the utility of a cross-referenced tabulation of performance abilities and 
performance assessment tasks in illuminating th-. state of-the-art m each of these areas. This approach 
affords the performance researcher a rapid-access mechanism for locatir.a both the theoretical research and 
the laborftory performance data related to a particular ability. Additionally, the Ability. Catalog provides 
an indication of the kinds of performance measures and theories in need of further devi^iopment. A 
discussion of identified shortfalls and suggestions for improvement follow. 

First, we find that a number of abilities are over-represented in termr of the number of measures that 
are used to assess them. Consider, for example, "Perceptual Speed" which is the ability to compare 
objects and patterns quickly and accurately. Cur survey indicates that this constaict has been isolated iri 
eight separate batteries and is implicated in no less than forty-two assessment laskv. This suggests several 
possibilities: (1) certain abilities are not unitary, or at least do not constitute an exclusive category, (2) tJiere 
is an abundance of tasks that measure different things but which are not tliemselves unitary i.e., one task 
may tap multiple si&s. or (3) task battery development has progressed asymn.etrically with examples of 
over- and under- representation in evidence. It seems likely that each of these suppositions is accurate to 
some extent. 

In general, it appears that current computerized performance assessment batteries measure those 
characteristics that they are most facile at measuring~e.g., rsaction tir,ie, perceptual speed, 
memorization-regardless of the maningfulness of «!uch measurement for real-worid application, in the 
UTC-PAB, for example, "Memorization" is a requisite ability for performance on five separate tasks, 
"Perceptual Speed" an element of twelve tasks, and "Response Orientation" a component of four tasks. 
On the other hand, this battery, which represents a Tri-Service effc rt to develop the state-of-the-art in 
computerized performance assessment, offers no measure of "Problem Sensitivity"-the abu.Jy to quickly 
recognize the occurrence of a problem-certainly a critical ability for on-the-job perfonnance in most 
environments. Similariy, by reference to Section II B it nay be seen that the Oommunication domain oi 
abilities (see Table 2) i!-; tnder-reprer ited in the batteries reviewed, and the Physical domain has oeen 
virtually ignored-presumably because these abilities are less am«3nable to microcompuier assessment, in 
sum, it can be argued that microconr puter task battery development has emphasized such issues as 
psychometric acceptability and/or administration convenience insttad of developing a tool with which to 
comprehensively examine the cpan of abilities which constitute human performance. Thus, we have a 
phthora of tasks with which to measure reaction time, but a paucity of measures assessing "Originality , 
"Fluency of Ideas", or "Problem Sensitivity". 

More than half of the abilities examined-twenty-seven of fifty-two-were not represented by any 
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microcomputer-administered task. While a number of these (e.g., "Stamma" and "Sound Localization") may 
not be suitable for assessment by microcomputei , they are no less critical for job performance m specific 
worl< environments. Due to the limitations inherenl in the microcomputer format, then, comprehensive 
assessment o' the ful, range of human abilities related to many jobs requires that oiher assessment 
techniques be employed as complements to a microcomputer-based task battery . 

In addition to Fleishman and his associates, taxonomies of wori< situations or work environments 
have been presented by a number of authors. One of the most developed of these is that of Holland 
(1985) in which six task types are presented: 

Realistic- mechanical or technical tasks 

Intellectual- tasks requiring generation or verification of knowledge 

Artistic- creative or aesthetic tasks 

Social- personal contact or interpersonal tasks 

Enterprising- manipulative or persuasive tasks 

Conventional- routine or precise tasks 
While the majority of real-world tasks fall into the Realistic c-{\egory, most tasks are also composites of these 
task types For example, a particular task muy be primarily Realistic, but may have significant Social and 
Enterprising components. 

The Fleishman abilities requirements approach, upon which the present effort is based, seems 
primarily oriented to the Realistio'Conventior il task lypes. The cognitive/perceptual/psychomotor skills 
that predominate this approach as well s,., the associated tasks which populate the microcomputer batteries 
reflect this emphasis. Conversely, we find that the social, persuasive, and, to some extent, the 
creative types of abilities are largely absent from consideration. Thus, it can be argued tnat a lar^e domain ot 
wort< sett'igs and a number of perforn^.ance abilities have oeen overioc.^ed in the current abilities 
requirements approach, which, of course, weakens our predictive capabilities with reopect to such settings. 

Another area shown by the present effort to be in need of more intensive inquiry is that of team 
performar.oe. With the single exception of the Code-lock Solving task on the f^TPB, no such "group- 
emphasis was seen ir any of the reports reviewed during the current project. The emphasis given to team 
performance by both model and task battery creators alike should, of course, reflect t.ie incidence of such 
performance in the real-world. Again, it is the task analysis of these jobs (i.e., the third element of the 
proposed research program) which will provide the requisite information. It is fully expected, however, that, 
similar to consideration of "Problom Sensitivity", the issue of team or group perfoimance (as well as the 
related issue, of team/group training) is in need of substantiaily increased investigation. 

Laboratory task batteries, then, r^ed 'o more accurately reflect the abilities requiremerns of actual 
jobs Future efforts in the current research program will likely find similar disc, jpencies (albeit 
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be^ween/among "'♦ferent elements) when evaluating the relative emphases of abilities in jobs versus that m 
performance models. Regrettably, this \z not a new problem. In 1970 Dudek expressed the need to ma:^e 
human factors research data "...inter-comparable and more meaningful to direct application. " This need stm 
exists. 

..'^i the other hand, Dudek (1970) also called for "... the standardization of tasks and measures used 
in human factors research to assure comparable results from study to study..." Our review indicates that 
considerable advances have been made in this area. The best example is, perhaps, the UTC-PAB, which, 
as suggested by its nare (Unified Tri Services...), represents a concerted, cooperative effort to achieve 
such Standardization. Fortunately, the impact of these standardization effo.ts will extend well beyond the 
U S military since the UTC-PAB, as well as its predecesiiors, the CTS, WRAIK-PAB, and PETER/NAVAL 
CCT batteries are available for use by researchers in the private sector. An interesting sidelight to the 
standai-dizatior Issue is the apparer.. acceptance of the IBM PC as the "standard" for 
performance battery implementation. The UTC-PAB is being written for IBM-PCs while the CTS, 
vVRAIR-PAB, and Taskmaster batteries are either being converted to or additionally written for IBivl 
equiprtient. 

The recommendations made as a result of the current effort are "expansive" in n&iUre. That is, we 
believe that tnis approach has been validated and that we must now add to this scheme: 

a) the real-world job task analysis information; 

b) more performance models/theories -with appropriate distinctions made between 
them (per Meister,1985); and 

c) a validation of the subjective ability/task judgments made in tne Ability Catalog 
accomplished through a quantitative evaluation of the link betwe.^n specific 
perfOiTTiance abilities and assessment instruments. 

Finally, we nay need to consider use of other ability taxonomies in addition to that of Fleish-nan & 
OuaiPtance. While this taxonomy defines the most extensive list of abilities, its ongin and. therefore, its 
priman/ stremth, is in the psychomotor domain. As systems impose increasing cognitive and decreasing 
physical demands on operators, H will be necessary to thoroughly catagorize the human cognitive abilities 
utilized in these jobs. Indeed, Braune & Foshay (1983) propose that we may neeo to refine our traditional 
task analytic approach in order to understanc' 'ormance in "highly dynam.c complex environments" sucii 
as aviation and nuclear power plant operations. A taxonomic scheme such as that used by Allen, et al. 
(1978) or Guilford's Structure of Intellect (Guilford & Hoepfner, 1971) v.. '^ "...remains the m.)st complete 
taxonomic system for describing intellectual functioning" (Fleishman & Quaintance, 1984), may prove to be 
of great value in catagorizing and understanding the role of cognitive abilities in these new dynamic, 
complex jobs. Performance assessment batteries and performance models/theories must reflect this 
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change in emphasis toward such issues as "Problem Sensitivity" and away from "Reaction Time". It is 
hoped that this Directory and its subsequent revisions will aid this process. 
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